
If the: student had not prescribefi i t^lusix^le opti 
^rac|kc«. Had fee aelected the >tf 



*iegy:^^4eteria^iiCp 
• the season,, tlie f^ottm ^^^^ 

We th« «tu4«i>^ has ' deft^tra 



itery of the !M»afei|ient task (within * Kj 
^^thi loose t<Jr^T«nces of this iii^l^^^^ keyword cheicJ 



00 YOi):tfISB TO SEE TBE 






1» updellog. r 

ih«4 : is only an int^roductioo^ 

trilnite#' to the' rM«arcb 'progr 
ctional purpoMf 

t gwB6 for iostrvcti^^^^^ 
^nt» of « realistic **^?*^^^^'°^ 

'iii^ 'ptocedoti^ ,aod';8Utia^ic^l. -i»«^^ 

sfeit'P^iiia''^^ 

ibr-^aaursMait «d omtrol activttiaa, mA wAlj^t lpe^; tl»«» ^fcneoeasarily on 

agcMnt '^cilaioBa of Jtha student; af fact not oniy-^ popolatlon, but aao 
attltirfe and^^^^a^^ dincatnad about ther"— * 

jjatulkt UVijBg^ 1^ tot eiaaple in the siagila |ia 

pp^r^ reipottds^ "Fishery is concarnad SDou^^e luw cab 
Utd it ,f all as low ,W 5 ,000 . lieoikilc aiil pk>H tica 
will be expanded.' 








can Slid 
staff* Perhaps 



o 



him sha^' hl^^W^^^ in the 



for c 



can anticipate eh* perfonMnce aide theae atodetits will f in4 in Job^ a|»d to hobbiea . ; ^ 
and i«r«ti« fiyi^ yaaP8 later. The eapeirieoc* vith caipprter^t^^ of writing 
'iJarci8ee«is(«»i4^.M 

Jqpni^lia|A 4ti^^ ^^e next 4ecade when chejr tBCMOiter tim pechoda of colter 
aaaiatanci to Wtij*r ^icj»^^*^^ 





it tfid jcoiiaMtnt TMc^^ 







Mil 








iQfgsuichWlMaiy sMs ' 
iinfiluenc€gre8Qitr£e^ 

and alternatigo^B^ltggsjWiBLHt^gj&^^^ ^SS^ 

of such asse3smgil^^B3UjfgBL^ ^[^toi]aa^^ 

components that vlMB^:^^^^^ ^^SBtttM syX€^ m«n^ 

curriculum programs, iW&^M &ormsyW^^Wr& oj^ of iriafe 

viduallzed instruction, p^BES^^(S^^^ ^Efe^fii^^ t:oxc ^^33S 
based learning; or it may pu l^^TO pl^^^^gojI pSmlg il^tt^ in ^glfcfc^ 

^jgEMggnyeh t ir e new^sygte^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^J: 
^^grately, for it is ^^^^^^^^^^^^^^^^^^^^^^^^^g^^^g^^^ 
l^j^ful apart from the sy¥g^H5^Kt3^^^^^^^^^^^^®iSH 
goiMsjgEfcess should be based onTOpleiaPtgtW 







social a^Sgn^ggemgl^^Bffi^^E MM 
o Are local^ ^]^^^B^ ^ri^^^ ^ffl^^g^ ^^^^ jr^B.tfi^ ^^M^^^ 

investing thlx^^ ^M^^^Bj^TOcljoffl Bn^ due 
o What are the ba^R^g smroMi^pLiemi^njya]^^ ~ 
If implementation actually ^b^^ ^B^^Rtei ^^^BB3£aE5:ifgl £^^ 



applied, such as number of u seYs^ ggalWfe jejEc<g MM^^ rep 1 icgfS^fe 

(is the product or process still TelSSri^abJl^Kj^^^M MfeMo u t of tl gl^^ 
hands of the original developers?), ^^^i^^ mrjCs^n^ gtH^gperf ormai ^g^_ 
indicators, distribution of use among t^gCtep:QRQlgM:o?s^^ unin^n3e^_ 
side effects, ^ """^^ 

Assessment of the products of development and .experiment at i^Mrat^^ 
in itself become a major R&D activity. Planning for approprfcagegej ^^^fe 
tion should be part of the program development process, as^mghgj^^^^^g:- 
by Crawford (1972D3iflMHilgarecent study of JHiara gS^t of e d u c a t i o n a. ffl MSS ^ 
mx:criifc€^^ffim>£d^^^^M&h^ level of eva lHatrf. ^hW@^ gMi^^ 
a^^)!i^^amsSSS ^^^^^ fflB^j>^ffgt^^ t^te 

c:ug5iMiMB?:apS^g€ 

Bh:g^g(gfiS^<^^^g a1t^[^ 



iM5Mp¥nMl^B^^^5gKg^fim3fe^ g 
itCstjSiaW hroiu g^ 
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£a:c:c:e:ss3ubUlgo:p:| j^EfflrHl 

mcWMgs will share tfl ^^iSi^g^^TCi^^ llfatSfigQ^ ^ 
iT>:aBlWi^6 r i t e r i a will n gt^Mg^ hm^tesr eBflfcCblf ^^^^ 

>s, Williams (197^^^^^^^^^^^^^^^^^^^^^^^^^^^^ig^^gM 
Itg^ttlBgS n ally been sensitive ftpBsml ^^^^^ ^^j^^Blilt^^^^^ _ " ; 

l^g^^B ecord of accountabili^^^^^^^ ^^M^^efi^^^^j^^^^^ ^Qf^^ 
^gint where "administrative purity |^jaBS: @megi^^ Sl^^^^^f^^S fi^t^ 

There will ^^^a^g^SdeSgi^^^^^^^^^^^^^^^^^^^^g^^^^^p^ 
tSvgyer , preclseJPyaBSgaiise ^'fairnes^toj^a^gQgtgc^gg 
Eo^erseers ^and^Mggfeis^^ ^l^^^S rsiiga^^ goffe de ggsre 

ilggon fiict withffi RSP 
^ppcaa^^CTKejNIEamM^g^ fe^ _ 

ggelSt^BllBaS MRi^^ Wt^yfxsc^ 

^=inanaWmlaifg^ 

iitsaSMp^ ppsal^^ ^^^fcg on 
y^arasenta^gSnlt feSnl^^ ^ 

jplrSKosalgexa^^ fi^^TCfeoji^ 

fflgtgidi vffjcsgi ai^reMNjjfc ~ai 

>63faygSmfSBtligsift^nTd£^^ 




jEffeSv^l l^^^^SfW^t^B^^ var i ogsg ^lggeni^gM^ocedu , the - 

Kyagi(£ Mvyt^ ned parttesM^ 





33iBMrjexdjB[gwifl?lBi^^ 
^^^^^ Hresjs BfiBait^^^^ o f way s S^BS^^^fi^^e missions of the NI^^^ - 
^^^Hffig^^gMM EHMl ^roS tion, but^f ^^S^MiS ctly applicable to tt^^ _ _ 

jgBiS^MMMraH^ ^^^M^^Mve educational^S SPriae h and development sy^i - 
E^^^^^ BBffil^^ iroM@g teffi85nal criteria ar e s^iii^t ime s made to selgir^ghilr 
Lurp:o:sjS™t hCT^^SwoTO^ ^ 1 i c ab le for gauging the e f f e c t i vene js^^^ - 

j^^^e for gauging the effectiveness of R @gg^- 
S^^^ ^M Wt^e tg^ffigj^B^ources ^ despite the great d i f f e r e ric^^l j£ngtlreL 
g^^^^&expast ggi^Big^B^^w o areas.) This omission is quite ^Tli^^- _ 

before t ggb^^T^jaS^Maifen^S^B^^^^ftg^ 
the ab^ietBS^ ^^^^MSggeil^K^^gs^^ 

m^m If the NI^^^nl^Bf5iOTsugl:¥^^ 
missi^i^ ^B^Mlln ^RSIffl^^lgti^^ 



^TalbgBi 5ftne\>a ff^^ 
gi¥lWdjEH^HlQBEh:eyBflig^^ 

s^h^ffiajtweggsBfiffl^ 




^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

ycnsiderations Tfi^ ^^^ igtjM^ HBSmi^ dMsSpS rgg 
evaluation * ' canno t^( ^aMt^ffilM^@)M ^^|^^ M^gJfl^ ^^^i^^ 

p • 130)- 




JU^SffiLnessMof Evalua tion 

Luation, to be useful fo1^s3KtfiiWt^^ MntuloMi ave tft^^= 
char5g^^^3.c8 : it must be competent ; Itg^^MBl^^^Eeyat^^ and it ^g^fc 
be honest* Unfortunately, particularly vbg£^^ ^lTO3^^W^ to provlj^^^j 
feedback for improving an agency* s R&D strateg^^^^^^ ^^^ is ma yp^gl^j 

conflict, as has been noted by Glennan (1969). ^— ^^ ^^^ ^ 

IflhayCTsISSerstgawe^ types of studilCTtWCTneWMtoabeBearrJ^^ 
on fairly TCSffgl^GBuS l^KnTO^ to provide a substSnt ^^Cfif B^^gi^ffi 
base for evalua¥i mgam[dttncre^8(^ i t s caliber. This backlg^ ffl8lMri^ ^^^ 
unlikely to get donWonWily s t emat ic basis unless the NIE^lBgg gMfts poni^^ft. 
a good portion of it * ^UUff lfess legislatld nTO^gj eni^^ggl^^ 
earm arkWfSHH^fteyaUTS^^ 
Igl^iwia^Bone^ ^CT^^ff^ 

g^^ancWtigll^ gyiipi^ ^ 
ggencyl Bfatoa^e gi^^^ 
rexjMnlnedliRfglS^gM 





gph competence and honesty require objectivity, and thgMLgp38gg£tf^S^ 

^S;@^SnJsj^ ld be carried out as an independefi^^^^^<^^^^^^^^^^E 

lEl^^a^K:^t<EggW gd5^i^:o^^ 
Ltib^empjti ^^rz^gcSTOlCQ^^ 

Jo en su r^^W^^T gM^B^ gjBjOmiBB ^gin^K^ S^ 

strategy miglTl Mfg^^fWiawigroMl^roro ^— " 



define the p u r ptrsj^BM^ft^^M^^ ^^LU ^auagl^MS JME^B 

background s t ud ie sT ^OTi^^ ^^KS^ &^ 11S%M^gpl^^^g^ ^^5i^^^ ^B^^B =^Sr 
out as much as p o s s iKt^tt yTOju^iB a^^ BEt^^ ^Bm^^flB MlaBfe 
feedback for the NIE; hc5W6^^ ^^Jslr@ n:d ^:uijp:o:s:eB^^ 
if the NIE succeeds in ob t ai^5i g^<g^g^ ftteej m!B^ 
information for its own needs r^^^M ^Mf^Sig ifsynS^Bfflgdri^Rlg^ 
the assessments generated by indeWtfflSirgg^j^srereiCT^ig^^ilt^ 
and outsidegggxiynment. It is tro be hdp ^MRSWsJeft ax^ro ^fflittihn^fe 
will take place so that completely indeperiae^^^^^^^^^^^^^^^^^^J^& 
vag^ggl of the evaluative information ^^gl^^^^J^^^^^^^^^^^^^r^^ 
tfi^BtlE in its turn will welcome and us^TTOSpienTd^^tofipj^aii^^^^ 



Using EvalfllSonBiffl sul t s 




lemmanagement 

MresjDurcigalllW^giToCT 

^ffiBuffBlMMbjgroicionsj^^ 



Lexamp S/i^lB anBi^le:^^^^ 





^nd for Ind^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^Bp^^^^^^^ 

ssiepmyg * The assessm^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

MBSffl^e nt R&D styles (e.g, 

gBaag^g the degree of d irec t i ^a^^^^ ^^p lrdgS^^^S^^l^^^^^jHl^^ 
^w^ay lsggf soliciting proposals, cha^^gg^^o^sal e valuat i^a^sfianisms ^ 
^att^^H us ting monitoring procedures. 3£ E^gi y, quality and ^^^^d i^Stegr 
jagggsgin en t s should also feed into the consideration oJ^^HlMi^^^^^^^^^B 

be needed to improve performance. The^^^^M^^^iSi 
mi[®ge^aagMa fgBibution questions have alreadabe^nydlC^ussed 1 

ie^gglSgglg in resougg^mllocatlonMCE gMgai gment pr%r^SrXs3 
tr^^B^feaaa^^TOiSai^fa plemen t a t ion may require chanigesmti agenlSy^ 
gal:am^W)ep:endS.TO ^ of reor ga nization neexieids 

raT8S^Smen^(^^EhjtgMtw^ 

roMNewMpo^x^j^dl^CTt^^ 

BMl^Mage^ffcyaiMjnroTprCT^ 

P MGXyenWg rguiTsTOraM 
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Theri^sjMtRrgcmc^^ are most likely tolb^ fiii^ ^^^^ gtgjg i^s^^g^ 



g^dag^^ fcfi^SWi^^Clhln the cjjg^ ^^ o f a pa rtlgujjr^^j^b 
gbUl3^1^^^)eg flgc:^^^ 

ErjBsuljt of evaliggj^^W^t^^MBieMLBrtj^^ 




directions 

^^^aSuation result 8^^^^^^^^^^^^^^^^^^^^^^^^^^^^g2^&^^^ 
jS^i^lfluals or groups rei^^^^^^^^^^^^^^^^^^^^^^^^^^f^J^g ggti-^ 
SSe^mis not often truth f^^^^ ^^^^^^nW^mmWlMW^!^0^1 ^i, 
say; "Ordinarily, howe^^^^^^^^^^^^^^^^^^^^^^^^^ 
;aaence them] have preconceptioi^a feojitaan^ ^ 
Bsa^eva luation^^»A decisionm al^M5KCTg^^yaM:^^BI^S* l*^^^ 
liewdl^al^ only»wh^MMiffg l#ifesM^^^^^B^ r 

3^1^SS[^^M^fflH^M5ifree from f lavsm€ha»lM6^Egi ^^^ 
ifitt^^^M^MSt^B^ltM gr pAXpj s purpose, Ch^t^cj^ffiRmT^^^ 

iiiaj^M^^RisSiff^Mensut 

HSejuIgg gMgtetHiB^^^ i^" 




i(gyallgtlS^tfl^^^^^M? f^^ M^M^ 





gfgssiohaTs^M 

|media , ig^SN jj|^^!^M^^^g1 ^^y ^M:^^ gg^^^^g^^^ 
rcomp e t en cegg^lt^^pOa^jgg; ggff jj^^ ^^fftM ift 
another m^^rf^E t^tgfe^B ^jgfc^i^ 

formal evaluCSI^^^El ^^^Msj gggS^ ^ro^BSS EttS?^ 

evaluate its pei^j^ ^^^gE hey will b gp^^^gfeg! by the agerig^sMLSa^ 
as created by the sl^fJE=There is no inoi 



:ant concern fo^BgB ^^ 

NIE, for its ability to carry out its missions and any judgment orilffi^gl 
worth will ultimately" depend on it, g 




mm 
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Hj^iams^^a ^M^Maig^J ^iffiMME^ 




cAconyersatiqnal problem-solving language such as 

be much ra a regional computing 9ervj^^ ^^^^fflg:#gt^ lg 3^^^g#^^ 

like Coursewritet^^^ dfevelopment of hlgh-guali t g^^^^ ^ tiw3a^«a3Bi^ SSa 
a major comitinen of >f unds and personnel, including ^^^^g 



U^dla speciaHs^^t^ and prograoroers not usually ava^^^^ ^^^^^^p ^^^ ^^i 
^Typically, fine person at a site* almost never on ap^^^^^^SSfer l^jj 




aemoiistir|ttionSt teadi progranail^ on a^S 

computing language can be more easily t au&Kt^m^ ^^^^^^^^^^tf ^^ff ^^^tei 
resources. 



lli^ pro^Iem-solyin will be over-valued and misai^ ^^ ^fg^fe 

five yeargiago. l^i^^^ ^^^^^^ trMctiorial ma t e ri aimsA^^^^jM 

to lu^^^ro thii^ ^^^^^^^^^^^^^^^^^^^^ p^^^fc^ffigtib^ 
computerlzatloh o^^^ ^^^^MI^^^E^^M ^ KM 



Clears 





^^^^ ^^^ ^^^^ ^g^^ gactlve mode of ^^^^xa^^^^^^^^l 




^though graphiic capabiMjty is much sought ter by many comput^^^^^^^ 
lekricted to dlphanumetlc displays, those who do have the techni^^^^^^ 
to show: the stu|ent line drawlpgs and accept simple sketches in retui^ find the 



7) :•. 




associated programing task horrendous. Progrannilng problems 



not beet^ solved for instructional users . 
8*^ Other modes not defined (l.e,. , ff^l 



h potential to »eet unan 




other modes of use may not be included in the listing above, a^^^^^^^ , 
are vet to t>e conrr.wo. p^^^^W^ 





D. Suitability for the Style of Progran PreparatW ■ 



If the progiraaBilng lilnguage cap^ilj^ieJ^ndM^^ ^ ^ 

LnsAructionaJ^iroeraaia^ 

^^^^^^^ ^^^^^ yill ^W^^^^^t and V^^^ 
wil] — — 





Authorl 

than ar^^^^^^^MHB^^ M^^BB 
expressions IftMsMffitHBasa^^ 
Most authbrs o^^?S»^K 
and «e»ory ^ pe thaps 
iTules, /or because the 

|pf prograMilng languages^^^^^^^WtH^ 
w>Mfloi ^able approach mtll ' soae breakthroi^ Jj> 
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sag 



^^^Bie field ;?^,aii4^tt^^ _ _ 

^ Ire^thls approaclv 



mm 



e -could 
students 





Izing In- computer appllcatloni. j 

guages or data foxvats which maxim^^^^^ ^^^^^ 



instructioiial 



a library ofi^trategies and too auch ind 
tandardized techniques tp be useful 



ectfUii ^or a topic are^gihgy veil defined 
andard fir^eduif^es f o^ taatlannp <S 



develop m ent c 
lin that topic Is no t likely to be succMaf ul ^ 



^^tical application of standard procac 

carrlcuiys^Jtles on any specif Ic at 

quest^^^^^^^^ .InforMti^ at^^ 
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.endeavor cwi^ Indl^dual M^^^^^ 




the language features , 
kinds of use.' 



mm 



aiHregt a^laogtiage-^processor ia^arallAle for a partli 



^ , and evec^ffig^ 



spe^flc cgQ 
Sig^n mist be detailed: 
fttlon^ nuaber of 



Different 
spedficat^ 
processing 






be printed out oti reqiie ^^^Bi s they appear to be needed, but in tl 
^proach has been expensive and inc<»plete. Cosputer-based manualsf 
be attractive, especially for the experimntal language which is contlnui^^^^Sj^ 
changed, making difficult the maintenance of current Information in prJ^^^fijiMlfa ^ 

An introiiucCory manual or primer for a language ^ system reduces 
COstLyvlive instruction to initiate new users. Primer^ have been i ^^^^^ ^M 
used while wbtking^t the terminal of an interactive system, inv||J||p^^^Mw 
to test each new <^wntion or concept as it Is described in Jti€^^B^^^^ 
self-ins triictibn has also been presented bjr films or video tlf 




expense and>Le8sened convenience 




^^^KntATEGY^ OF INS^ ^^^ 




Soi^^^^n designers have wished Wi^ass lnfot»atibn^^^^^^ student ^^^^^^^^ 

or provide suanary infotkatlon for >ll, whether for w>rmatlVe Infbniatl ^^^ ^ 
Brning task <^ 8»e or ^^^^^^ 




r. HaivAllng^^^^^^C^ Well iag'Tiaiertg ^tfi^^tefa^ " 






O 



1 - /; 



The facility for recording' information In a lo^ Is of special si 
educatlbnal appllcatloos of co^utera^ and was not typical of earileir sf^^^^ff^ 
prepared specifically for coB^uter instruction, Further»ore» the ^^w^ 

status and of the occurrence of paj^lcula^ transactlbna are needed f or on^^^fe 
decisions* . ■ / ■ ■ . / 

The best tactic for record-keeping in a researchrorlented systei^w 
continually a log of everything which happens; and thfen let the . research^^^^^ - 
put what they need later. However^ sn operational system servicing s^d^^^p^ 
teachers ecoooaically should log oiily the information certain to b ^H^^^^ y^fe 
'a format suitable for quidi and Inexpensive stamarlzatlon lor use ^^^^^^B^l^ 
sanagers of -the ins true tloti 





H^mi else* , 





Attempts to imposfe a single major standard language ( or i^^^^ 

iOjri^st^^^^^ to- e8tit>lish trans^a^ kton^^^putlbn^ i^^^ 

If one couW assemble enough 8upp<|rt^^te^^^^^ a definition of a standai^^^^^ 

ble. Although the allot 
be made isondll^^fa 



imposing this standard would be 
federal funds for currlculiai develo 

fundtwlll continue to from a varle'ty\^of sources , including^^ 

ina^tutions wha generate material for their own use, 

Although Strong forces will be encQuntered against dl_^^^^^^_^^ 
/language is not the i^brtant goal. Because of the gr^^Mj 
process in instructional programming » a 



might be In bti&iness or scien 
If there is to %k only one 1 





r^granting 




mm 




^^^ ^ffl remain a ^ o ^^^^g B^M ^^Sg^^^ ro^B^^^ ^S d be; made througH^^^^^p5S[^Ma^ 





\%fho repr^^^ 




: the course. 



Standardization, or more; reasonably » "translatability*' of 
ercises from one system l^d^pM J e^^^ require^^^^^^^^^pawar^^ 

III ag^ ^^^^ ^^^^poffi^^^^cts oi ^^^ ^ ffl^^ffl 
Iffi^nteract^^^^^^^^^Syffi^^^P 



^ a^m £^^&m ric^ j 




Clearly somgx^efui w 



done Jwl till llaited^^^^^^^^fflM^ 3tfi^^ 





' in charge has conve^^t^^g 



the^^B^B 




Docu<i«ntation ha? :tw6 main ;f unctions, inf ormatlonV try amlss^^ ^^^ ^ ^ 
fili^iiflcat^hp It transaits i^ifotaa 

(1) cpntcn^fi of instruction. and effective use and applicmtior^^^^v , ^' 
psbgraa. ' , Xt^ siiaplif ies work by V V(3^^^ usar , to find 

potential trouble spots; :(2) >88istitig the user toveUl^Mt«;^^^ 
•ay/ arise, , (3) sl»plifylng r^vislo^ and (4) alding^^e^^p*i 

At the same time one consider s^^g^ gesM^^^ Ifcitids ffl^ 

transiations of co«pute^^^^^^^^^^^^^^^^^W^^B|gM> 





^gg lon of a p^^^^^^Jt^^Sem^l^g 



specialists 





^^P^^^^^^l^re no t suitable for describing th'e^^^n^ 

^^Bfe5fefi^^S5®ise, and other means^^^^f^^ I 

Leant portion of a^ 



A coiMiun li^g ^ aiBdium f6r talking abotft^ iMtniction vlll p^^^^^^^^: 
tBor^ reas^roS laarnirig tasks, ^an<| serve also as a slgolf Ic^^^^^gft 
advancing instruction research and strategies of curriculum d^p 



2 ; To reviewers and potehtifJ. users 




The difficult task of sele cting^^^^^je^^^^^^ reference sou fej^^j ffi^fl^j^t 
is . complicated when the author hS^^^^^W h^s 



(along vlth soM strategy for gridaai^^^^mliiig^^^^^^^^^^^^^^^i|^^^^ 
user should ilbt^haiw ta^ uqai^aififele: 




Within a number df applied research prdjects some means ^^^^ni 



# curriculum designers to^ conouinlcate wl th compute^^jtragra 




vforaatsv special notations, etc* These temporary measures^ 
continuing evolution; of prograiBiiing languages fSt ins 
could be forma>i2ed Into a AlXable "ptA lai^^^^ 





Htmans can Interpret by context maoiy stat 
find ambiguous^ and this ^chlne 4efici«^ 
expense of ^rograimlng and proc<?-;ai^^^ tt 

, ^okputer^pTOgraire^b^ ^^^^^^^^^^^M^^^B^^^gfe^i 
the curriculum ^eaj^^^^^^^ ^^^^h^l M 



Iqulckly and accurate 








^^^^^p^l uago Is deslral^^b ^g jaa^^n^l techno^ 



of procedure be'cqpes ttore readable ^ ^^^^ r^erallzed p^ ^^^ffl s can be apj^^^- 
in other si tt^ general, a fomal language approprtately requlte§;^^C 

'to^ the machine to do. ■ 



Education and 
of teqh^uiM to 
lea ^^ ^ ^B^ lals> 

discourse about purpo8€ 
language for coaputer i»pl« 




, in particular, the^^^ajlH^B^ftg^^MiEy i 
c> f se 1 f "ins true t ion anl^^^^ ^^^^^^^ ^^tf I ^ 
e of inadeouate comuni cation wi tlft^^^^^te 
I jRua t us^/k le lat iye ly 
^^^Ma bef ote i t will b€ 








^ ^^^^^ m^mM^g type h all) > or^an electronic ^isplay will ^^^^^^B^* 
ro^^^^ ^^^^B ^^^d cHaracters tb W gaaerated (as oil a^CRTvOj^^^a 

pHate hardware attad^ ^ 



When the subject expert and educajylonal t^ 
thei^ real purposes ^ the peculiarities of current 
prograaiing langUagesy they sho\dd leave the computer ^^^^^^ 
essential parsMters of the learning situation are detend^^B 
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, 1.. INTRODUCTION 

/ 

A. Scope- of Computer Use in this !leport 

In innovative schools throughout North America, learners are using the 
computer to drill second Iranguag/^ vocabulary, practice problem solving in 
algebrS, simulate a national economy, model a theory about inheritance of 
^t«iaits, and retrieve information about films and other learning resources 
_.releVant to an \ndividual program of study* ' Researchers are using the* 



computer to administer complicated experiments, record and analyze aata, 
build models of -student d^arning and performance, and reduce the limitations 
on communication between man and machine. Project CLUE (Computer Learning 
Under Evaluation) has considered the use of computers for ins.£ruction, lirst, 
as a tool for instruction -and, second, for research on learning axi^Xeaching. 

Administrative uses of the computer for reco.rd keeping, scheduling, resource 
allocation, and data processing were not included in 'survey and review 
activities t and are mentioned only inci'dentally. Although Chese administrative 
uses are extremely important to educators, critical review of this area was 
not as urgent as for the instructioMdT domain* In particular attention has 
beeq given to the ^conversational tutorial" uses of computingx which are the 
subject of some controversy. _ ^ ' 

Interactive uses of the .computer with the user "op-line" (directly connected) 
are often quite costly to implement at their present stage of development 
and occasionally the same function can be served just as effectively and 
less expensively "off-line" (without ^direct connection). The scope \of 
Project"CLIJE includes all-uses of the computer, for instruction, whetfter the 
student waits one second or 24 hours for a reply* Sx)me systems # are arranged 
to provide results in^from one to 30 minutes from a "remote job entry" \ 
terminal. The user does not have to carry his punched cards to the con^\iter 
^center but is able to interact with the machine using a*^dard reader and \ ^ 
printer located for his convenience* - "» 
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/■ ^ The uses'of the .omputer as an instructional, aid have been represented by 
/ various initials including CAI, CBI, CMI, CAL, CAE, and many pthers. These 
/ labels tend, to become associated for- some persons^with particular uses of 
. ' computers or university projects or computer manufacturers. As a result any 
single ^ame can mean different things to different readers. 

"Computer-assisted" or "computer-aided instruction" (CAI) is now the most 
commonly used acronym^ ^If the computer's role is to assist the teacher in 
managing instruction^ by handling performance records and. curriculum files, the 
--■ ^ lab^Iis "computer-managed instruction" (CMI). However, many projects and 
manufacturers use variations of these two labels. 

Authors of Project CLUE interpretat^ions'have avoid'ed 'acronyms . When the CAI 
* label is used it refers to a narrow definition of computer use, e.g., drill 
and tutorial activity. " More 'comp'rehensive labels are intended to suggest a 
\ broad range: "computer-based learning activity," or the "computer as a 
f\ learning tool," or "Interactive uses in instruction." These phrases emphasize 
^ '\ the le_ar~lng process as muc/as a highly controlled/instruction process, and 
\ the extension of the intellectual capabilities of the user as much ts the / 
\ testing of his factual knowledge. 

\ • • / 

\n the next Jew paragraphs the domain of Project CLUE is summarized in terms" 
the manner of computer use as listed in Figure 1.1 (see also Appendix D) . 

■ Instruction and the learning process . The most visible use of computers in 
instruction is" to provide- direct assistance for learners or^trainees, or for 
teachers, administrators, educational technologists and others who may wish 
to help learners. Any of these persons ifiay pursue computer-related work 
individually at a user station or in groups of various sizes, direttly 
' connected to a, computer (on-line) or not connected (off-line), with real or 
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hypothetical computers, and so forth. Some typical subdivisions for this 
category of use are given in the first part of Figure 1.1. 

Management of instructional resources and processes . Essentially clerical 
assistance can be important. Although uses in this category initially were 
considered to be aids to teachers and others concerned with supervising the 
instructional process, information and assistance can. be provided to students 
directly without interj^ention of adult teachers and managers. 

Within the various filc'-s for management of instructional resources and 
processes, the essential information is about student performance, learning 
materials, desired outcomes, job opportunities and Student iitterests. The user 
would be able to compare his own performance, interests and goals with those 
of other students. After analyzing his performance, the student Should be able 
to move into the materials file to find suitable help and *4ien continue this 
self-directed activity by exploring the job opportunity or interest file. 

Preparation and display of materials , Computers can be used to assemble 
Individualized text and problems well in advance of their use by learners; 
^terials then can be distributed by the most economical means. Generation of 
materials in "real time," that is, as needed by a student in a seminar or by 
a teacher during a lecture, is impressive but usually not necessary. Figure' 1.1 
includes some interesting, subcategories of. preparation and display:, generating 
films, testing text materials, editing.and analyzing texts, and representing 
knowledge by information structures. 
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INSTRUCTION AND LEARNING PROCESS , 
Drill 

Skills practice 

Author^con trolled tutcyrial ^ ;^ 
ires tLxngT and diagnosis ' '» ^r>^~^ 
Dialogue tutorial 
Slmuldcion - , ^ , . 

Gaining ' 
Information ^4trieval and.' prc^^essing 

Comput^vl'OR:^' ^ 

Problem gdlving *^ 

Mod^ (^^stxiiction _ (procedural) 

Dilplajt^ohs tTurt±oir-(-graphie-)-- — 



MANAGEMENT OF INSTRUCTIONAL RESOURCES AND PROCESSES 

Student records: selection and summarization 
Materials files: r^etrieval via descriptors 
' Desired outcomes, jqb opportunities, interests, etc. 



PREPARATION AND DISPLAY OF MATERIALS. 



Procedures for generating -films, graphs, etc. ^ * \ 

laboratory for developing and testing text and graphic materials 
Procedure's for generating of text on an individual basis 

Procedures for automatically editing and analyzing text materials for new uses 
Information structures for representing knowledge/ objectives and materials 



OTHER USES 



Educational administration: accounting, scheduling, planning, etc* 
Educational research: institutional, sociological, psychological, etc. 
Applied uses: science, technology, management, banking, production, etc. 



Figure 1.1 Summary Classification of Computer Uses 
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Other uses. df information processtng r A number of oth.er potentially interesting 
categories are listed in Figure 1.1 but without elaboration since they are not 
.central to this discussion, ^Nevertheless , users should consider 
Educational implications of computers in administration (accounting, scheduling, 
plLannirig, etc.), research (institutional, soc4olpgical, psychological, 
instructional, etc.), and the relation of instruction to various applied 
^usW» The last area is' especially important because of increasing needs for 
trl^ining' in computer use for jobs in science, technology, management, banking,^ 
production ana retailing. - . ' ' 



" t: ■ v 

B. intended Audience ^ . . ^ 

the documents of Project CLUE are arranged in several sections to meet the 
differVnt needs of three audiences: 1) .students of educational technology and 
interested laymen; 2) educational administrators, teachers and : instructional- 
system Wnagers; 3) educational psychologists, and. computer scientists* 

^ ^ . - t 

\ ^ \ 

To the ^tudi^nt and layman, tlie report qffers an introduction to the present 
performance, problems, and potential of computer uses in education. Samples 
of instructional programs and their usjbs have been annotated. Tecljnical 
terminology has been minimized in the summary and interpretive sections. 
Much of the specialised vocabulary for the field is clarified by common 
language^jefljii^^ and examples in a glossary (Appendix E of Volume 1), 

The admin;Lstrator or , teacher .who is already familiar with the debate about ^ 
computers in educational technology will find the guidelines for using computers 
in education most valuable. He may also acquire background information to 

supi^ort planning of project proposals and new programs. 

f ■ f 

i 

For the specialist in the research and development of instrijgtional uses of 
computers, materials from which the guidelines were derived provide detail on 
differing opinions regarding computer instruction^, dimensions underlying 



5 , . ' I 1 Introduction «- 

« 

» * 
computer use in- education, and'' comments on system design. iThe index should 
assist in locating material on specific subjects or learning the opinions ^ 
of certain writers.^ . , . ' 

i , , ^ 

The first, volume offers a perspeciive on the purposes and goals of 'the study, 

provides an interpretive overview, and present? guidelines for computer use. 

Five appendices include annotated examples of instructional -^rtOgraras, 

abstracts of representative educational projects using computers, a listing 

of the domain for instructional uses, a glossary, and a guide to other sources 

of interpretation, reports, and, recommendations* Students, laymen, administrators 

and teachers should find parts of Volume I useful. 

^ ' • * - ^ . ^ i 

The second volume of the report includes six position statements: operations 

i " 

and costs, development of computer-based learning materials, programming^^ 
languuges,^ evaluation of ma^terials and strategy, research on instruction 
and learning, anil documentation and distribution of information and learning 
materials. Each position statement incorporates interpretation and reaction 
from persons knowledgeable in that area. Bibliographies placed at the end of 
each statement j^hclude references to all persons and papers from which the 
statements were derived as well as a few suggested readings. 

f>'The'tour appendices document the method of the study and dissemination, list 
^projects contacted, suggest activities for professional societies and other 
organizations, and offer notes on computer system design for instructional 
uses. Educational researchers* and computer scientists * should find some pprts 
of Volume II- of interest. 

C/ Chronology of Project .Activities 

A f raijiework for discussion and review activity was- derived from published 
reports on computer use during the early months of Project CLUE (January through 
March 1969)* Staff members searched for -current and relevant materials in order 
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to interpret what was being done, what had beep planned, and what was judged 
to be most needed and iroportaiit. Project directors and other' per^.ons active 
in.research and development programs throughput North America responded to 
'Requests for materials^describing their current 'work. StSff members visited 
many sites of interest and attended meetings and conferBnces at which computer 
uses in instruction were discussed. Details" are given in Appendix A of Volume II, 

Drafts of five statements of points of view were assembled during the summer and 
mriled to all persons quoted directly and to other interested and knowledgeable 
individuals in the field.. Rdvisions were made by Project CLUE staff during the 
fall ani^winter, and a preliminary draft of the statements was distributed for 
review and (^oiamen,t— in February 19-70. 

" The appendices were" assembled during the. spring of 1970 and distributed to' 
Obtain confirmation and correction of information- given about persons and 
institutions mentioned. Most of the documents were revised during the summer 
and were' , distributed for comment by paVticipants at three major conferences 
in August and , September-: the IFIP World Conference on Computer Education, 
the Education Sector of the ACM 70 Conyention, and the Conference on Computers 
in Undergraduate ^Science Teaching. • Discussion at these meetings shapid yet 

'..pne more reviWon before publication fbr wider distribution. \ 



Throughout the project, CLUE staff members coordinated their efforts wich those 
of other projects reviewing the use of computeprs in education, including: 
.a study of the computer in higher education, RA.ND Corporation; a survey of 
computer uses in college teaching, MIT; program' planning by the National 
Council for Educationa^TTechnology, London; and numerous single conferences 
and symposia. f * 
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2. SUMM/VRY OF GUIDELINES . } ' 

The state n.'.mLt%r rprhnolQcv for Instructional uses £s well establisMd; 
appHcacions and -further de'veiopaent should proceed. Computer systems and ■ ^ 
programing languages are ■ available' which are adequate to the tasks iavolyed 
in developiSent and presentation q£ learning materials. App^licatlons have been 
demonstrated for various kinds df^comptiter use and in a wide varie^jy of 
subjects; many ojc these are available through- telephone coni^ctions with 
regional computing services^ and av^ilabilirty for some is extended nationally 
by networks o£ computers. Perhaps tfetr-biggest probl*em facing the potential . 
user concerns the identification of the resources availabO-e to him and then 
selection of the most 'appropriate among them. Matching the right kind , of 
computing system, programmitig language and au|omated learning resources to 
th& requirements, needs and objectives of the learners can make the^^difference 
befeweeft success and failure for an applied project. 

In order to take advantage of the developing ^compuclns technology i^i learning. 
, and teaching, it is important to- begin more work now. institutions, sponsoring 
organizations, and professional societies should^ provide greater incentives , 
for the developiflent and effective use of quaUty materials in 
instruction. ^ " - ^ . ^ 

The intended audience for tbg^utdelines presented in Chapter 4 of this volume- 
includes the potential auf^tor, user and manager of computer applications in 
the instructional process.' and secondarily., the possible sponsor, whether it 
may be a..govemment ^agency, state office of education or the adminrstration 
of an individual sohool or college. A^Wsary of the guidelines in Chapter . 
'4 follows here* / \ 
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A. Management, operations and .costs of computer uses in inatrUction. - , 



The' most effective uses computer-related innovations will depend iA^^the- 
long-run, on significant reorg'titt^ft^ltm .of institutions* Many forces, social, 
Solitical and economic, a're pressing for greater re'spon^iveness of educational 
systems to individual^ needs and a changifv^soeiety, jCertain of the computer- ^ 
criented techr^ues vill help institutions raeet^the need^ of individuals and soci 

Computing* resources "^are now available at a modest cose, and^the expense of 
'computing aids will CQutinue to decrease. It is importanl: to select carefully 
among *the options^ailable, and to plan for effective use of' future 
' capabilities • \People-are the, most imp^ort:apt resource, and incentives should* 
"be established to encourage* the participation pf^ the best available authors, - 
teachers, technicians and other contributors to it\na^ti^ve activities. 



The funding of innovation should cover tfa^ time necessary to confirm the , 
effectiveness of new Resources and -techniques, VancLJ^oJsring the best ones to 
M^ly operational status within educational systems, „Cost effectiveness in, 
\the short run should not b^ the major considexetiQl/An a 'decision to introduce 
computers into instruct ion. and course development programs; the benefits in 
the- long, run^ which follow frotik introducing computing arid" information prdcessing 
now^are Worth some additional investment at ^t-h^^^ipe^-^ 

B, Development and evaluat^ion of computer-bas^d learning^materials* 

A broad context should be established for jreyiew and planning of the 
- appxopriate place for computing activities within curriculum and learning 
•activities* •Determination of goals should ^pkecfedesel^ctdfcn of methods and 
media. Both analytic arid heuristic approaches-^o materials development will 
contribute to the growing ^library pf computer-related curriculum resources. 



r 
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I 2 Summary 



the manag&nieiit of a computing facility for developmen- and instruction should 
be oriented to itK^usefs: authors, teachers, administrators, and especially^, 
students. * Effective suppott for users, in the 'form of reference materials, 
demons trht ions, training materials, and consultation as well programming 

^} wance, is a major consideration in furthering efficient and effective 
<j(^vciopment activity. Xhe same -requirements for user support apply to the 
assistance the author shpuld provide the teacher and student using computer- 
related ma-terials. The automation of some special assistance to the user is 



quite promising. 



A 



"iBetter .Incentive systems must be established to encourage curriculum 

developHient, distribyfion and, maintenance* Both professional and economic 

/ ' .i < ' ^ ' 

rewards should be provided by various institutions and organizations in 'the 

Educational system. ^ ^ , 

* * ' ' *^ 

V ^ * 

'it"* 

C. Programming languages and implications' for instructional strategy. 

No one language can be right for all u?ers;| each. mode of computer use has 
special requirements, and different styles of program preparation benefit 
from different language features* Although no languages will be widely 
adopted as standards, translation among languages of similar purpose will be 
quite practical. Exchange of materia^ls will be facilitated by Improved ^ 
documentation. (Section E, below, considers transfer from one project to 
anoj:her.) ^ 

The ^ needs of the learning environment should determine the prodedures 
or information processing used; language should be shaped by/t^e' instructional 
uses^fo^ it* remain fleicible, a project should work with^% a general-purpose 
system^providing more than ohe suitable programming langtjpge, or use a 
prelimlrary translation s t age ^ probably automatic, to from notations 
>^onven|ent for the authors/ into the prograciming lang;uage of the particular 
instructional computing system. The key* to serving' a variety of user needs 
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is adaptability to individual requirements of authors and topics of instruction; 
probably this will be achieved through automatic means for extension of 
languages^, , ^ , 

• ' ^■ • ^ ■ 

Programming languages and l^^arning activities using computing should be 
selected and shaped, to take advantage of opportunities for interaction . 
between the^learn^er and the collection of relevant information and procedures 
stored in the computer. Responsive computing reso.urces supporting an. 
env^ironment for problem solving can be arranged in convenient, task-oriented 
packages f or*useTii^ the solution of problems and 'exploration of data b^ses. 

A curriculum development group should ultimately remain free of the constraints 
of specific languages even to the extent of avoiding use of the com|mtBT7 ^ 
when the available software and progrannners cannot implement the important 
^features, of an instructioffal strkegy. .0& the ofchej- K^dat^^ei^^ or projects - 
.comftitted ^to exploiting the compute^^;in education should seledt carefully 
among possible applications^f or those which be^st match- coinputejr co^^^ to 
the - n^s.gf leirner_s_v- .Furthern^^^ the development of information 
proces^g cpols for learning shotdd be pursued with a . subject or discipline 
orientation rather than exclusively within the special area of instructional 
technology. » ' 

Introduction of computers into instruction, ^ 

Determination of needs and goa:a should be^ accomplished ^ith full participation 
at the local- level; concerned personnel^at all levels in an educational 
institution 'should guide the development of new resources for instruction 
whichwwill further the goals of the institution and thos6 it serves • 
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An important multiplying effect on the return for resources invested should 
be obtained by applying appropriate effort thorough information centers and 
training programs, Exchange programs should help spread expertfi^ among 
those who will. become leaders in local projects. 

A .new project should avoid the ^ use of the computer as a medium whicji may 
perpetuate inapprop^riate educational practices; imaginative uses of computing 
will emphasize genetal processes and problem solving more than specific facts 
and co^iVentions* Training programs should help teachers and authors adopt a 
flexible and creatl^\?e^pproach, attentive to the^i^eeds and reactions of — ' 
ihdividual students, and inform them about the implications of automatic 
• information processing for. society. Any program introducing computers into 
^education, ev^ If primarily for teaching other subjects, cannot ignore 
considerati^rs of generaf^Tiiputer knowledge and specific skills of computer 
use, ' * ... 

Computer-;bas^ systems should be introduced, into curriculum and instruction 
only to the e^ent that they make a better contribution for meeting -educational 
needs thin alternative systems and procedures.^ The use of the computer by 
students as a tool ^ undg^^jgi^r ctj^nlrol, for learning and problem solving can 
be recommended strpffflyTj^ lecords and materials 

'Students d^ectly as well a^ through teachers and administrators, is a 
promising aj plication* The presentation of J.tLCy;uc (exposition or ^ 
via the computer mav contribute significantly^ to learning and the 
3f a favorable fttreTTOae by some students having special needs resulting 
learning dl^bili/ties, cultural differences or gaps in educational background. 

I^ne practical apiTroach computer use in the instructio/al process is to make 
fthe information processing tools and 'data bases directl:/ av^lable to the 
reamer and let complex human skills and judgment of^c^4ldren and young adults 
be applied where scientific knowledge of the learning process is Inadequate 
to make specific prescriptions. In general, the scholar-teacher should 
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remain in charge of Vhe' introduce Uion of computer technology into the teaching 
.and learning activities, attending to the "uses of the computer in his- area af 
study, and to the advice of experts, on technical matters,' and most of all, to 
the reactions and performance of individual learners. 

E. Transfer of findings and materials from one project to another. 

Each project should produce documentation which warns .others about the 
shortcomings of an approach as well as provides encouragement to follow 
successful lines of development. Although the equipment used at one site may 
not be generally available, the successful applications can "be described in 
procedural terms from which adaptations can be prepared for other equipment. 

Authors should be provided grea^r incentives to document, distribute and 
r^ise eomputerrtaged exercise's;. economic and prolessional rewards should 
■derive from a disdSribution system involving institutions, professional . _ 
■ organizations, publishers, computing softwar? organizations, and computer 
manufacturers.' A first:.step is the early development of reviewing activities 
and other programs in professional societies . which will increase the amount 
and quality of materials developed. 

National and international programs should help distribute knowledge and 
expertise as well as computer-based materials. Prospective personnel for a 
project planned at one site should work for a time at 'another site which is . 
already operational. A mobile team of ejcperts might move from place to place 
. dontributing to the effective and ecchomical_3tabllshment of new projects at 
schools and colleges. A few -sample programs, demonstration systems and. ^ 
portable terminals should be. available for trial use by any. institution 
• considering the establishment of a new proj.ect. •. -, 
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Sources o/inf omation and consultation should be mainCained by national and 
regional cS^s, which are coordinated wi^i similar centers in other countries 
Conferences on 'computerr in education should^ be held regularly, some of them 
quite broad in scope and others specific to kreas of teaching and to 
exponents of £he. technology . Participants' sl^ould include, students as well- 
■as teachers in t4xe relevant disciplines, and^lso potential employers and 
others who may be served by education and trailing involving computers. 



1 



Project QLUE 



December 1970 



3. INTERPRETIVE OVERVIEW 



Insti^uctlonal uses of computers have been under Investigation for more than* 
10 years, ^and the field continues to change rapidly from year to year* The 
purpose of this overview is to provide a framework ^or discussion and 
recoi!iQendatlons » a few sp.eclflc examp^l^ of current and promising uses,. and 
referencWco more detailed information about research and development in 
this f ieid^. ' ' • i 

A BRIEF HISTORY 

y Plans were, begun on at least three projects in 1958. A desionstx^atioa of 
computer teaching of binary .arithmetic was' made at IBE*s\.Thoma8 J* Wit son 
Research Center, Yorktown Heights, N.Y., and wa^ reportedNby Gustave Rath 
and others in the book Automated Teaching edited by Eugene 6^1anter (Wiley, 
1959). Another research effort started at System Development Corporation, 

* Santa Monica^ 'California, about the same time; the coufputer was used to control 
a random-access ^projection device for presenting pages- of material in research 
on branching modes of progranmed instruction. J.^.R.- Llcklider^and John 
Swets, both of Bolt Beraneb^nd^ljewman, Caniridge, Massachusetts', were 
looking at a variety of computer uses in 1958 and 1959; one instructional 
* application was the construction of graphs in response to requests made by 

, students in analytic geometry. i ' ^ ^ 



/ 
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A second project, at the IBM- Watson Research Cg^pter grew out of Wiiriam Uttal's 
work on teachinj}^ machines ; he required more fogical capability than was 
conveniently achieved with* special purpo^ circuits in, non*-computer devices. 
A project initiated by Eionald Bitzer and D^aniel Alpert^ at the University of 
Illinois at about the- same time gWe particular attention to the design of 
convenient learning stations for the studen6^aiid simplified program entry 
procedures for the cun^iculum authpr* A conference sponsored by Systf^ 
Development Corporation and tl/e Office of Nav^ Research in October of . 



1961 Included a good aaj^ling of work on con^u^r-aided instruction and 
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related fields. The proceedings of that\ conference (Coulson, 1962) still 
c6nstltute a standard reference on Instructional applications of computers. 
Five major projects (and perhaps 11 different curriculum packages) *were 
reported at that time^ although more than half of the •package^ were short 
demonstration units. 



/ 
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The niunbet of distinguishable projects and samples of instructional materials 
probably doubled by. 1963, two years after the first conference. Curriculum 
packages designed at System Development Corporation and Watson Research 
Cenper had been used successfully with over a hundred students. A survey 
conducted in 1965 showed that the number, of projects and materials had 
doubled again in two more years^ Many of the curriculum programs were quite 
substantial and one of them at the l^ivlprsity of Illinois was in use for 
regular credit instruction.' 



\ 
\ 



The problems and potentials of this yoiing technology were discussed^ at three 
\ /significant conferences in the fall of 1965: The Coaputer in Physics Instruction 

(Commission »on College Physics, 1965), Computers in Higher sEducation (Gerard, 

\ * ' -- - " - - \ 

;i967) and The Computer in- American Education (Bushnell ind Allen, 1967). - ^ 

' • ' - ^ " ^ /" \ 

The proceedings of those sessions are readllys^btainab^X^e and together mak^ 

up a tisetul collection of examples opinion anS proj^t^tions. To obtain 

references to the most current information and opinion in this field, the ' 

re^ader should use Appendix A, a guide to informatlou sources in the area 

of I instructional uses of computers; 'this docximent is also distributed by 

th^ ERIC Clearinghouse on Educational Media and Technology, Cypress Hall, 

Stanford, ^California 94305. * \\ 

Special sessions on computers. in education began to occur regularly at 
meeting of American Educational Research Association (AER/V) , Association 
for Educational Data Systems (J^EDS) T Natioxfal Society for Programmed Instruction 
(NSPl) ,-^^sociatlon for Computl^ig Machinery (ACM)/,, and the Fall and Spring 
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Joint Computer Conferences.. of the American Feiieration of Information 
Processing Societies (AFIPS) . Conference members expressed ^ontiiyiiing 
enthusiasm about limited successes with existing applications, 1>ut^,thQy ^were 
becoming- sceptical of initial claims for extensive 'ins true tion'al possibilities 
with computer technology. 



Manufacturers aaid publishers were quite active in the area about 1965, 
making increasingly large capital investments. IBM, RCA, Philco-Ford, 
Technotoics and Computer Systems for ^Education officially announced the 
preparation of special-purpose computer-aided inst*uc!:ibn systems. ^ Activities 
weref.also taking place within Wastinghouse, Honeywell, Till, CDC and Burroughs. 
Sizeable field studies were conducted in several put lie school systems, 
particularly Philadelphia^ New York City, McComb County, Mississippi, and 
Water ford, Michigan, as well as in several schools working (Urectly with 
Stanford University. Use of interactive con^puting systems to teach computer 
programming and mathematics was spreading rapidly; two of ^ the. first projects C 
involved public schools in the vicinity of Boston (Project LOCAL) and both 
public and iJrivate schools n^ar Dartmouth College, Hanover, New Hamps'hire. 



Another set of conferences and review studies define the state of the new * 

♦ 

technology for instruction inT.968. The Cpllege Entrance Examination Board 
and the SoQial Science Research Council sponsored an invitational conference 
at the University of Texas in October of that year; the papers and critiques 

i prepared especially for that meeting , were published by Harper and Row in 
1970/ The r^T:erunl?v^sity . Communications Council (EDUCOM) had a . workings 

' group look at "firdjgratoiing languages j documentation, and validation problems* 
in Instructional applications of cc^uters. The final report of Phase I, 
supported by the Office of Naval -^lesMtch, is .available from EDUCOK In Boston 
(100 Charles River Plaza, 02114) . The 'Office of Education est^li&hed a 
pilot project ^called CUES) to explore the full range ctf ^practical coirrouter ^ 
applications in secondary schools; the plan. was developed from feasibility - ^ 
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' studies conducted by IBM and G^^neral Learning^'Corporation and a revievr and 
extension by^Computation Planning, Inc. The ERIC Clearinghouse on. Ediicational 
Media and Technology at Stanford .University distributed a pair of position 
'statements on current practice and future trepdsby John Feldhusen and ^ 
Robert Morgan. 

A study of computers, and instruction is being conducted by the RAND Corporation 
' Santa Monica, California, for the Kerr' Commission on Higher Educaton, and 
another by staf^ at the Mir Sloan School d£ Management. This overview. is 
taken from the *final report of a study jxju^t completed at the University of 
Michigan using the Icode name Project CLUE» All three efforts Were\coordinated 
by itheir directors, and arrangements' made for contributions to related 
conferences such as the Symposium on Computer-based Le^rning^ Systems organized 
by the National Council for Educational ^Technology in the United Kingdom. 

Another round of conference actimty in 1970 almost duplicated the set of 
meetings^held in the fall of- 1965* The University of Iowa and the National 
Science. Foundation organized aj'Coriference on Computers In Undergraduate 
Curricula, and it wasr well atrended T>y authors an^ potential * users ^f computer- 
based learning materials. The Commission on College Physics organized another 
l*6ok at computers in science teaching, reviewing progress since a 1965 meeting. 
Following ,the leadership of the International/ Federation for Information 
. Processing, several groups cooperated in the first World Goaf erence. on ^ 
Computer Education; it successfully brought together persons working on 
educational training programs for eff ective^use o£ jcomputers (e.g. , training 
computer programmers) with persons working on the effective use of computers ' 
in education (e.g.,. supporting instruction in biology or classics) . The 
ACM annual conference included a major section on education with particular 
attention to computers in the inutructional process. The Center for 
v^ducation Researcfi and Innovation (CERI) of the Organization for Economic 

Cooperation and Development (OECD) held two meetings (March and October l^d) . 
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to examine computers in higher educaclon and to explore prospects for increased 
cooperation among projects in different- countries. Another pair of OECD ^ 
meetings in March an4 December of thie,same 'year looked at computer studies ^ . 
in secondary^ schools, giving special attention to curriculum and to the y 
training of teachers. ^ • 

The field haa gtovm to such a size that it is difficult to cite. all of tKe 
work -in research and development. Ove-r 200 distlogAiishable projects of some 
magnitude are' in opera^on and "more than 1000 samples -c^f curriculum materials 
using computer presentations Have been nsted, although 'perhaps only AO of 
tMm are fu;Ll courses. Abstracts and interpretation of projects and instructional 
strategies can be found in periodic literature such as the Review of Educational 
R^earch , and in information flies such as, those of Entelek Incorporated; 
Newburyporf, Massachusetts, and th^ Instructionai Media Laboratory of ^the 
University of Wisconsin at Milwaukee. (See Appendix A,)* 

the field continues to grow in 1971 in spite , of -cutbacks in federal; spending. 
The technology continues to change tapidly and considerable variefe))^ is apparent 
in systems, programming languages^ and instructional strategies.* Although 
it is di^icult to characterize this diversity iri a few pages, the foUowing 
sections include a. variety of specific examples ^ ^ ' ^ 

CUR^T FACILITIES ASD USES- ' ' * * ' , . 

Many different kinds, of computer and software systems are being used by 
research and development projects today. Some small machines have been 
programmed for use by one student ait a time executing stored programs, - . 
- simulations , .or designing his own computation routines or computer-T)ased * 
games, and te^t exerciseT^fof^ Other- students^^^^O of the first was a Digital 
Equipment Corporation (DEC) PDP-7 used by Harlan Lane anddthers at the 
University of Michigan for tWining and research on. language skills. Syst^ 
that are somewhat larger but in a similar way dedicated to interactive 
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instruction have been programmed for sim'ultaneous use by anywhere from 4 
to.. 40 students. Larger systems are in' operation which can handle up to 
200 studehts using the sawe or similar application programs; systems for up 
to 4000 simultaneous users have been planned. At present it^is difficult ^ 
^ to find 4000^ ot even 200. students who want to use similar programs- at the 
same time and 'place, and an institution whose administrators wish to pay ■ . , 

the price.^ . ■ . . . 

Other research and development projects have" used_ general-purpose conversational . 
systems, imbedding the InstructiSi^l applications among other software 
packages available to users. Under fhese conditions, the student may use , , , 
the same compuper for controlled instruction sequerices, self-testing, situ- , 
ulation, gaming, and problem-solving^ Time-sharing computer systems^at 
System Development Corporatfon,: MIT and Dartmouth were, early examples of this 
general-purpose approach, although the- designers of -these systems probably 
did not consider their work to be related # computer-assisted Instruction. 

\ - ' - * . ■ . , (3-- ' 

Programming languages and systems ("software") exhibit ^even more diversity 
^ than the computing equipment ("hardware"). ;More than 40 languages and dialects 
have been developed specifically for programming conversational instruction, 
but mihy of their differences are .superficial and eome obvious needs of users 
still have not been satisfied. There is good reason for different languages; at 
^least five different fcinis of users have distinguist»able requirements : Instroctors , 
^ufii^rsV instructional researchers , /admlnistratDrs , andfcomputer programmers 
'SlJking with any of the first 'four ,t^es. 'xhe characteri-stics of different 

&djject- areas also n^ce^^^^ different language featu^6s. Although the 

^ , existing iWvmges cWot be arranged neatly by user or application, one attempt 
' 18, sh^^telow; organized by the way the instructional programming looks^ to 
x-Aiielesson-design^Onl^^ are given for:each kind of programming. 

The report (Zlnni 1969) .from Shlch- this was' taken provides a preliminary 
asspssiae^it of how well user tieeds are being met and^jronsideta coimon practices. 




I 3 Overview ' ^ ^ . ^ 

i' 

in- languages and documentation. A *later report (2inn, 1971) offers 
additional interpretation and recommendation. 

I:anguageV~f5ir~description o£ successive frames or items: ^ ^ ^ 

COPSEWRITER I for" the IBM 1400, COURnEWRITER II for the IBM 1500, and 
COURSEWRITER III for the IBM 360, all products of Intematfonal Business 
Machines (IBM)* • ^ 

COMPUTES!, COMPUTEST-Il, prepared for various machines by ^taff at the 
Computation Center pf the University of California, and PILOT, San Francisco, 

COPI I and II for the UNIVAC 1108,^ developed by UNIVAC in' Minneapolis. 

TUTOR for the PLATO III" and PLATp .IV Systems at the Cbmp/iter-based-^^ 
Research Laboratory^ University of Illinois, Urbana. I J ' ^ 

PLAHIT, developed andvdistribut^d by SystCTi Il(evelopment Corporation,,; 

Santa Monica> California. * ' - ^ \ 

Languages *for description of procedures by which material (in curriculum files) 

^s presented: ^ ' ^>^^ 

TSA, prepared for a PDP-I at the CAl L^^oratory, Itistltute for Mathematical 
Studies in the Behavioral Sciences, St^f^d University, Stanford, California. 

^ISL-1 and ISL-2 for the RCA, Instructional Systems X70 and 71)-, Palo Alto, 
'^^''^"-Californla. • .v. - ^ . 

XXXX <Untyerslty of Minnesota, Minneapolis) ^ . . " 

FORTRAN, ALGOL, MAD, SNOBOL, TRAC, and other languages in general use 
'\ for scientific ^rogranming applications may also be used. 

Languages for sp^tifiBation of an environment for programming and problem 
s.olving: . . / v 

> i _ -x - 

APL was baseOn- specif Icatrions for "A Program Iverson 
_--in 1962 and S.s ^now ^ popular language for time sharing systfems. 

BASIC, deveioped at-^Dartmouth College In New Hampstiire^^is now the most | 
widely available of the' convenient (student-oriented) programming languages. ^ 

' JOSS .was the first of the .on-line, interactive programming-, languages , 
and the desrigner Jules W. Schwartz at a^d Corporation set a model for 
many others which followed (TELCOMP, PIL,GAL, BRUIN, ISIS, LGC, and others)- 
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.was developed by researchers' at the University of Edinburgh and is 
rjow available conmiercially* 

! 

^ itUSH is an on-line version of PL/1 prepared by the Allan-Babcock Company 
for its tiiae sharing servicf. ' 

TIELCOMP, ISRCOM? AND STRGCOMP were developed at Bolt Beranek and Newman 
i damoridge, Massachusetts, and TELCOMP is available commercislly^ 

, I I , - , ' ' , 

Instructional materials have been, written in almost all subject areas and 
for joslay age levels: preschool, reading, elementary school science laboratory,^ 
ititersiediate school social etudi-^ games, high school biology laboratory, 
college mathematics » Iritiroductory German, chemist^* laboratory * ahd professional 
scl^oo|. exercises in bqsln^sji .management*, medical diagnosis, architectural 
pldiftt^Lng, etc. Some of the san5)les pwbably make little use' o£ the coaq>utar 
as^ani information processing de^ce ^d %ould be as effective and less expensive 
^jittj another mode,. e,g*, a book or fll&^c^trldge- ^ 

Ti^e costs of using these various operational or experimental systems and __ - 
languages vary considerably* Flgurres reported by matiufacturera or research 
Iprojects rangct from $0*25 to ,$15*00 per hour* Some of the differences can 
Jbe: attributed to variations in assumptions abou^/iibw- many effective student 
IhcHirs can be^, scheduled in a month or a y«ar, whether the equipment is rented ^ 
rlepsed or pjjirchased, and how much time will be spent In-, utility johs, preventive 
maint^enance or repair* The Computer-^Based Education Hesearch Laooratory 
tCERL) at the University of IlUnols (Urbana), plans to achieve a f igure- 
ofi30^^jper student hour at consoles including. heyboard, graphic display 
and image projector^ witfi all curriculum development costs- included* The^ \ 
project plans to ^be operating a few hundred such user stations over 
telephbne lines by the' end of .1972, and is discussed by its originators, - 
Bltzer ^ahd Alpert (1969). . - ^ 

Whatever, the hardware and ccHnmunication costs may be, the initial financial 
hufdle fs the high ctst of infixes tment dn curriculum design and validation. 
Estimates xange fxom $20,000 to $2,0t}0,000 to produce 100 hours of adjubct 
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student. Before self-study material .in text f pri ma t~"l s adapted for computer 
presentation, the potential contributions oX an automated instruction system ^ 
sKould be considered. First, the machine evaluates a-response constructed 
by the student, using the author's key as ,a standard; an automated procedure 
prints out discrepancie^s, tafllies scores "and:-s.-l«ct.3 remedial or parichment 
"material. Second', the machine can conceal~aiin:p_.8ome extent control the 
teaching material so that the author can specify greater complexity 'and 
assume more accuracy than is possible when^e-student is expected to find 
his place in. the pagea^of ^^large booklet .^^ird, the computer can carry 
out operations, specif led by the student in sifl^ile programming languages 
or design systems.' Fourth, the author, or -xeseafcher obtains ctetailed data 
on student performance 'and perhaps attitude^^ and conveniyit sunmarizatlon 
of student accomplishment- ready for- interpretation. Fifth, the author is 
able to modify his text and prepare alternative versions-with relative ease. 

Perhaps an adjustment of* goals and an application of new techniques will 
achieve more dramatic results' in individualized learning . activities than 
simple computerization of text. For examplerdevelopers might g±vk greater 
attention to effective interaction between roan \n d machine during the learning 
process: what should be done by each person involved, and what should be 
done" by the 'machine? Adynamic information system might serve as a co.mnwn 

c _ \ » 

working' ground for a scholar and learner ;~coul<i they share a computer-based, 
primaiy^ource "textbook'^* tjiat is beinjjipdat^d^ continually by the scholar 
and anaota'ted occasionally by each student w|iq, uses it? 
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prx)Vicfe more possibilities for ijidividual^^f^apinif ion than a predetermined ^ 

sequence- of branches through a large pool of specific items. 

_ ^ I * 

Communication networks will play an impoctant^role in permitting the prepara- 
tion and use of con^uter-based exercises within "existing economic constraints* 
Expensive, instructional software on computers is not now used with large 
gaumbers of students. However, suitJable rfecworks will simulate and assist 

, groups of subject experts w ^ work together on, computer-based materials for 
the same course at different schools. I?; may_ be^argued that materials 
developed on a cooperative basis will be more usable at different institutions 

--than^-^f—they w£ure.^4^eloped irtdependently. — ^FurfeiterTOre, guidelines for 



organization and document atton of compiiter-liased-exercises will make ad;at?tation 
and use at another school easier, especially^ since the text can be searched 
and edited readily while producing new copy for local students, 



Nqitworks of regional conq>uter services will distribute information-processing 
capability which individual instit^tions or community education programs 
could not afford independently. The l^ational Science Foundation funded a 
number of ^experiments having central resources located at Dartmouth, Cornell, 
Oregon State, Triangle Universities Computation Center (North Carolina), 
Xlilnoi*s. Institute of Techno logy7 and others, and-^ene combining resources at 



various primary tjuuLw^M w*. ^*^h^ -*^v.^^^. _ , ^ 

way. an automated infomuitfon system could help a learner and, teacher share 

a.conmjon working environment for l^ypothesis testing, sometimes artificial 

as in computer simulatioA of physical and social processes (e.g., a model 

of evolution), and sometimes re^ in the sense of actu4. data- from experiments 

(e.g..- election returns or radiation measures). 

Some computer users suggest that the most important contribution of computers 
to instruction and learning is the increase in acce^sd,l,ility of information 
processing tools for learners and other users. A large number of projects, 
most of them not con^i^ered to be computer-assisted ins^uction in a narrow 
sense, have shown viable alternatives "tio strictly specified instructional 
strategies for computer use in the schools today, 

7 i 

Whatever the technique or philosophy* of . coi^uter Use, tM extent of - use^ill 
ultiimtely be determined by judgments of appropriateness br subject everts, 
effectiveness observed from records of studdit per-§or«aac4. and costs which 
must be tDet by administrators of schools \or training programs. Favorable 
economics for regulaf use of" automated silf-inetruction may depend on computer 
ai^for preparation and revision of material, self-modifying strategies 
of i^truction. and automatic assembly of additional" teaching samples or 
-testing situations. ' Some of the limitations- imposed by present computer 
technology involve the cost and unreliability of procetesitig lei^thy ve.-bal " 
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in an entertaining article in Computer Decisions^ recently reminded his reader$ 
that developers iTiay be underestimating the power of the computer for learning 
and the inclination of individual learners to explore. He included a picture 
of Mickey Mouse wearing the magical^ hat of the sorcerer (to whom he was an ' 
apprentice ij\ the film)- and playing with the stars. The caption reads: 

^the./'^omputer is a universal control system, let)^*s give kids universes 
:o control*" 

# 

In the Walt Disney film^ Mickey played with the powers of the universe while 

his master was away, and spoiled it all by comanding the broom to bring ^ 

water froi5 the creek and pour 3^ into a barrel in the cottage - a task Mickey 

didn't like at all, Jut he did not know how to stop the broom from carrying 

♦ 

in the water, and the cottage was flooded* 



/ 



Nelson seems concerned about^ a strong tendency to put in the computer those 
exercises which seem easy to implement and are uninteresting for hum^s to 
do* Lengthy co'^rses of tutorial and drill are made operational withouls. reviewing 
carefully whether the goals and p jctice exercises are worthwhile for the . 
students at all. 



Who is to control this new resource for self^-ediication? Will the learner 



r= — ^'u^ rrrs- 



^, ............ - 

important b^ii^ause of /the teacher's ina bility to provide adequate supervision 
during learning e'Vercises. Teaching nmchines can encourage students to 
practice independent searching and self-feaching, as well as monitor and 
assist the students when they are'^given difficult or ill-defined tasks. 
Computer assiiitance- will be used as a to'ol^jby curriculum planners , lesson 
designers, and teachers as well* as students to^afehleye^^cpmmon e^^ 
objectives. The next section describes* typical uses in several^major areas. 




Examples of Curr ent Uses , 

— ■ - ■ ' ■ / 

Several modes or uses of computers in instruction are listed in Apperiaix D 
and samples are given in ^pendix C. The materia3>4n^Jaiese pages exemplify 
iiist three major kinds of uses for students. They are followed by a description 
of computer aids for arf instructor, curriculum authbr, or researcher. 

One of the underling dia^nsions of applications fcr stude'nts is that of 
author or program control. At one extreme, the student can do only what 
the program allows;- typically he finds himself mor^ restricted than he is 
with a textbook or set of dittoed exercises. At the other extreme, Ihe computer 
is programn^d to setve the student as a tool in the management of inf onpetion 
necessary for solving problems*,- and the student is given almost complete 

control* It is also possible for the lesson designed to progtam the computer 

* * 1 I * 

to respond in set ways but leave the initiative to the student; the learner 
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is encouraged to explore tbe materials or model by whatever means he finds^\ 
most efficient or interesting. 



.1 



nr-fn ^ Tutorial; and Dialogue . , . • , \ ' 

computer as.istaoje with drills and presentation of ^ext is most often given'; 
■the label "computer-as.isted instruction" (CAD . Many s-tudent hours at . 
a terminal have 'been lagged with drill exercises because it is easy ^to •, 
asse- .le large amomts of material, assign it to large numbers of students. 
and service many simultaneous users on a relatively small machine. However, 
if economic criteria are important, the users must consider alternate ways 
of achieving the objectives which can be met by computer-delivered drill 
exercises. The best known exaBiplef of drkl in regular instruction is 
the elementary school curriculum for mptheWics and language skills 
d^v^loped by Patrick Suppes and Richard Atki\son and tested initi^Uy in 
the. schools of Palo. Alto, qallfomla, McCoi^ /Mississippi, Waterford, Michigan, 
and New York City. 

♦ 

^Other applications have been used- for language instruction at the college 
level.' One project which has accMpul^ted many Wura of student experience ^ 
is the language laboratory at the State University of . New 'York at Stony ^ 
Bjook.' A course in Russian was developed at Stanford which combines ^ 

■^computer-deliveied .practice with otter language l^orktory exercises and 
individual meetings' with the instructor. , 

— y \ * 

:At the University of Michigan- a student console was especially designed 
for use with a small computer' for training prosodic characteristics of speech. 
The aural response from the student is compared with the recorded model 
just played for the student; the extent and direction of discrepancy in pitch - 
loudness, or tempo imediately regiscc-r on a eero-center meT:er. Progress 
with the exercises is determined by the .individual 'performance of each 
student, The.computei^is usod to average the signals in order to cancel out 
the differences in base pitch or loudness (e.g., a female stud^t responding 

/ 



/ 
/ 
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to a male, native-language speake'"r) , to adjust the tolerance for error in . 
response to student performance, and to convert the audio parameters from 
physical units to the logarithmic, psychological units more meaningful to 
the let.rner# , 'r- , 

• ■ - .. -A ' 

Many hours of instruction have been prepared in the tutorial^mode probably 
because this manner of computer use is familiar and comfortable for a . 
college professor interested in educational technology. Much of the work 
done at Penn State, E;iorida State, and* other university-based* projects can 
be characterized as individualized, tutorial adaptations of lecture or 
textbook material. Many dollars have been invested in the development of 
a few computerized, programmed-inst ruction courses; a significant part must 
be spent for implementation of a particular computer system. 

Some instructional, programs of the tutorial variety are designed to encourage 
additional^ initiative on the part of the ^student, and to provide a relevant 
reply to whatever* questions, comments or concrusions,Jxe may type in. Typically, 
the author of such an exercise has provided in the computer program 'a set 
of conditional statements which, for atl]^_$tage of discussion, make the 
computer reply dependent not only on thTltUa^nt^s current inquiry or assertion, 
but als/f^^ the* history of the conversation.^ The classic example of this 
type of lise Is a medical di'^agnosis exercise developed by Feurzeig and others 
at Bolt Beranek and Newman.' The Icfarning situation is characterized by 
stages of examination and laboratory tests alternated, with "discussion" of 
a tentative diagnosis with an automated mentor. The computer program keeps 
the student on the right track, and responds to his diagnostic attempts in 
light of information he has already acquired. An example of a notation suited 
for describing such learning exercises is'^iven in Figure 3.1* Annotations 
on the program appear in brackets. ^ - ' 

Problem solvin^ exercises in physics have been programmed by Edwin Taylor 
and others at MIT to provide information at the request of the student and 

' Project CLUE . *' July 1971 • 
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GENERAL "Proceed with investigation." 

ACCEPT 

IF /suspects/ 

1) "Wife, brother and partner*" 

2) "No new suspects," 

IF /lab/ rifle, glass, pipe/ 
IF ALL REPORTS, GO TO LAB 

^ "I advise you to check reports first, "^ 

IF /interrogate/ 

IF ALL LAB, ,G0 TO INTERR 

"I advise you request lab tests first." 

"I don't understand." 

LAB "This Is .the lab." 
IF /glass/ 
IF WIFE 

"Glass contained arsenic •" 

1) "Prints belong' to the wife/V 

2) "Nothing new," 
"What is it you want?" 

* ACCEPT 
TO LAB + 1 . 



[messages within quotation 
marks are typed for the student, 
annotations are in brackets] 

[accept directive from student] 

[did the student mention 
"suspects"] 

[first time, tell him this] 
[second time, type this] 

[did he* ask about any of these?] 

[only after he has all reports 
permit him to request 
laboratory, tests] 



[if nothing is recognized in 
his directive] 



[if he mentions the "Glass^'*] 

[if he has already interrogated 
the wife] 1 



[otherwise these replies] 



[if no lab test request 'is 
recognized] 



[go back to process a new 
directive] 



Figure 3,1; Sample of a notation suited for exercises in decisi'oif making 
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eventually to check his" solution.^ The computer , extracts key wo^ds and phrases 
fy^om the student input for use in the reply assembled by the author^s program, 
simulating a personal conversation. The progranming language used by the 
autiior is an extension of one^ designed by Joseph Weizenbaum and called 
Eliza. A particular advantage of Weizenbaum's technique is that the program 
can be written to confirm each time what was "understood" by the collection 
of words recognized in the student's message. 

' . ^ \ 

The benefits unique to computer presentation and control have not yet been 

isolated. Some advantage is anticipated Tjecause the author is able to ^ 

write instructions for processing cjojis^tructed responses, branahing according 

* ' to complex strategies, and controlling and concealing material appropriately 

for each individual student. However, few lesson designers have made use 
of capabilities beyond those which can be accomplished with' the printed format. 
Although the computer may have played a significant role in improvement 
o# instruction by coercing the author into more careful organization, testing, 

^ * and revision of material, in the end his self-ins true wion package may be 
presented to students almost as effectively (and requiring considerably 
less time and money) in booklets and audio- visual modules • 

Simulation and Gaming 

4 « 

Apfflications in this category differ from the previous group in that the 

— A — ^ _____ »_ ' _ _ 

conversation between student and program, and the results the student ob- 

T 

tains ill playing the -game or exploring the simulation, do not have to^^e 
programiaed in detail by the designer of , the learning exercise* In other -7*^-^ 
* 'Words, the coiqjuter program underlying the game or simulatio"^ is a model 
designed 'to provide some appropriate reply to whatever the student may type 
as input for the model. Such programs can serve a variety of purposes; 
examination of the decision-making skills of a student during training, 
practice for a professional in problem situations which may not b^ encountered 

♦ 
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often enough^ to maintjain essential skills, and theoretical tests of new 
hypotheses in abstract situations which, although artificial, may be easily 
manipulated- 

Simulation for mUitary and industrial training usually attempts to achieve 
maximum fidelity in^ order, as much as possible, to replace experience in 
a real airplane, spatit^papsule, or "business management situation. However, 
it is sometimes desirable to give students experience in abstract situations 
which emphasize first one concept or relationship and then another, with 
little concern for realism. Learnings may be' more efficient and effective 
where the content* and complexity of a succession of exercises are carefully 
planned. Computer-based games may place the student in an even more abstract 
and less realistic situation.* Typically, a game provides specif ic payoffs • 
and introduces competfition with other students. Applications of botfr 
gaming and simulation are found in elementary school social studies, high 
school car^er_planning, college chemistry and graduate business training. 
A sample of a student exploring a simple concept in wildlife management 
follows^: / 



A student is given practice in managing one aspect of a siimilated salmon- fishing 
operation. The object of the game is to build up and maintain a population 
which will maximize the catch taken by the fishery.* The size of the run for 
the coming year^is determined by the computer in some way not known to the 
student, iLTthoirgTrTie does know- it-depends on the previous year's escapement;.^ ^ ' 



Conversation . - 

(Computer in capitals; 
player lower case" and indented) 



WHICH MANAGEMENT STRATEGY DO 
YOU WANT TO ADOPT? 



Comnentary 



The player haa^-^the^ choice of 
setting either escapement or 
catch. 



1 1^ 



♦catch 

CATCH FOR 196ff? 
16,000 
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ESCAPEMENT = 2,000 

CATCH FOR 1970? 
10,000 

ESCAPEMENT = 1,000 

CATCH FOR 1"971? 
5,000 



ESCAPEMENT =1,000 . 
.THE MEN AT THE FISHERY ARE 
DISTURBED ABOUT THE -LOW CATCH 

CATCH for 1972 , 
10,000 

NO FISH ESCAPED. LET'S START 
OVER AGAIN. . ' 

WHICH MANAGEMENT STRATEGY 
DO YOU WANT TO ADOPT? 



eiscapement 



ESCAPEMENT FOR 1969? 
15,000 

CATCH = 3,000 

THrMEN AT THE FISHERY ARE 
FURIOUS ^^UT THE LOW CATCH 

ESCAPEMENT FOR 1970? 
15,000 

CATCH - 11,000 . . 

ESCAPEMENT FOR 1971? 
10,000 

CAXdH = 15,000 .-kT 

ESCAPEMENT FOr'1972? 

9,000 ^ ^ 

CATCH « 21,000 



17 



/ 

The computer supplies the size 
of the escapement, and asks 
about the next year. 



The student notes that when ' 
2,000 escape (1969, above) the 
next y.ear*s run ia 11,000 
(catch of' 10.,000 plus 1,000 
escaping) • 



The studeiit should have kept 
th_e_ catch dovm until the 
populatidn had recovered. 



/ ^_ 

The student holds firm 
because he expects a 
much bigger run the next 
yeari. 



A 
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ESCAPEMENT FOR 19/3? 
9V000 

CATCH = 19,000 

YOUR TOTAL CATCH 'FOR THE LAST 
FIVE YEARS HAS BEEN 68,000 
SALMON—IS, 600 PER YEAR. 
DO YOU WISH TO DISCUSS THE 
OPTIMUM STRATEGY NOW? 



Aids for Information Handling 



The student graphs the data 
sp far, infers a relation- 
ship between escapement 
and the run the- following 
year, and is ready to 
switch to a subprogram 
which will "discuss" with 
him the optimal strategy. / 



I. 



convenient tools for automatic organl4ation and .retrieval of information should j 
be'useful to the student as they^are'to any scholar working with a broad ^/ | 
base of information. A number of ^experimental systems Ihow considerable ^ 
promise but are still rather expensive. Procedures have been proposed, /and 
some of them demonstrated, for stUdent organization and use of large / 
non-linear files of text which serve as? individualized reference arid instruc- 
tion systems. The BtMeat can V'e given Jools with which to reorganize and 
augment his personal copy of the basic file. this jnode students should 
be abl^ to accomplish more scholarly ^orfc of greaj^^^uality during a given , 
period of study, and to acquire more skill in sea^hingTEor^d organizing | 
information, than is possible through discontinuous '.encounterlj^ith structured 
and strictly controlled tutorial instruction*interspersed with ||riods of 
independent study. The= development bf^ur^iculum-f £^8 for th^Wnode is - 
significant because the £ol:e of .the^subject expert sK^ks from writer of ^ ... ^ 
detailed, step-by-sl*^^ introduction fori topic, to assembler of an approferiatC 
data base Jor 8tudeHV.^xplor-ation,^andito; com on the development cjf 

powerful aid? for explQT^tion-^dr'scTiolar^^ within those filfes' of/ 
infdrmation. One illustration Is art^^i^rifflental text-handling systeri 
developedTby Douglas Engelbart and jofcjps^^ Instit^t*. . 

Although Engelbart's system has not b^ljfi^edl ap^ecif ically f or i 
exploratory projects Ire in progress >lSpi§r^^*^^ interesting 
results to report concerning his tecKnlq^^^^"attj?nentation cf human 
intellect applied in education. 

^July 1971 ^ - 
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Computation mod« tends to be overlooked by the planner of the computer-based » 
instructional system^ perhaps because it is such an obvious application, or 
because it does not lootc like tutoriaT^structionv ^ A notable^ early experiment 
was conduLted in the Massachusetts Public Schools (Project LOCAL) in associa- 
tion witW Wallace Feurzeig at Bolt-Beran.ek and Newman. Student progrananing , 
and problem solving includes manipulation of symbols and words as well as 
numbers. Initially the students used remote computer services via texetype 
and phone lines; later^ small computers were placed in five public schools for 
multiple use by students at four or five terminals* 

College students and professional staff studying statistics on the System 
Development Corporation t^me-sharing system are able ^ evaluate one-line 
expressions, to'write and execute sic^jle computation routines, and to call 
on existing statistical packages. As the student moves from simple to 
complex problems, nK)re powerful computatiorl^l afds are plaqed at^his 
disposal. A computation and graphic display system developed by Glenn 
Culler and B.E. Fried has bfen used by mathematics and scienee students at 
the university of California campuses at Santa Barbara and Los Angeles, and 
at Harvard University. 

Computers are being used increasingly by artists and scholars to design or 
conduct research on musical coiiq>ositions , creative writings, . experimental 
films, and architectural designs. Students from tffise areas outside science 
and engineering can obtain convenient access to computing capability through 
well designed study carrels and readily comprehensible prx)grammin&-4anguages . 

Aids for Ins tructional ManaReroent 

It appears that public schools will be able to afford interactive conq)uter 
assistance for a few instructors and administrators before they can reach 
each Individual student directly* Aiding management of instruction is an ^ ' 
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appropriate beginning; knowledge gained through semi-automated handling of 
instructional materials and performance records will contribute to -effective^ 
implementation of other Interactive uses of computers by students directly. 

The Oakleaf School project in Pittsburgh began with much dependence on ^ 
teacher-student contact fo.r diagnosis and interpretation and a large 
clerical staff for grading tests , checking resource tables and arranging ^ 
ifesson materials in support Tf individually prescribed instruction. Gradually 
rhe clerical burden has been taken over by automated procedures, .and some / • 
of the more routine contact with students is being replaced by conversational 
interaction with computer programs. 

Tools for Author and Researcher ^ . ^ 

Programming languages are needed which are convenient for specifying inter- 
active instruction.^ EDUCOM working group (mentioned earlier) has assembled 
V set of documents which desci^bes various programming languages and identifies 
additional requirements of authors and researchers which are not^presently 
' satisfied. The report of Phase I of the EDUCOM study recoifflJ^nds increased 
facility for: expressing coii5>lex, coiiditional procedures; processing 
'quantities of algebraic expressions typed by the s^deht; assembling Instruc- 
fional material from elements of the subject matter and relationships among 
the elements defined^by the subject expert; interactive editing and arranging 
of materials; automatic summarization 'and selection of performance data; 
and integration of automated instruction with computer tools for learning. 

Si)i6e of t^e present experimental systems provide capability for interactive 
\|^oj[!^o^^4d^ana revision of materials. Programs have been written by 
' Leonard Uhr/ Jonathan Wexler, Jaim Carbonlll and others which generate the 
first draft of A computer-based learning exercise from a specially written 
text, a set of graded test papers, or a description of objectives for 
student performance at the end of the exercise* Existing examples may appear 
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trivial; it is difficult to handle sophisticated learning situations now, but 
generation of materials isjone of -the trends discussed in the next section. 

* *• 

TRENDS AND NEW DIRECTIONS 

A current trend in instructional use of ^co!i?)Uters appears to be^away from 

the programming of sequences to .">e delivered by the co^uter under strict 

control- of the author *s sequencing rules* Putting a prpgrammed booklet: 

into a computer may be more a hindrance thap*'a help ''to a motivated student 

who possesses reasonable study skills. Mote likely, managers of future 

systems will make the. primary sources of knowledge directly available to 

students through organized files of information and •procedures/ For this 

mode of study stMents will be given the necessary learning tools for 

information managemeat, con5)utation, and composition*^ Computers and electronic 

- - - \ • - 

technology, will be use^ much mpre widely in the future world of today *s 

sftideats, and' tli^ responsibilities they wlM assun^ will require greater 

skill of information acquisition and declsion^ making than is expected 

presently* ThTs suggests that today students should learn to use\nformation 

flleS' and the asso^Wted tools for learning and productive work. 

: ''' J- ; ■ ' ; ' 

For selected students ^r^^ certain ^instructional objectives the effectiveness 
of a 'computerized, author-controlled presentation will be sufficiently greater 
than experience with the same content in textbooks or audiovisual materials 
to justify the greater cost per unit of instruclton. Fo:. *v cample, many 
children lack the verbal skills, dlscriminattons, and a:ct^oiion span 'that 
may be needed^ for independent practice of some skills w± \ the aid of 
a computer; students ot any age dealing Wltl) written and t x languages may 
for similar reasons need computer assistance for diagnostic s 1^ testing 
of skills, ^ ' 
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Expensive, on-line systems will co-atintie to be used foi; reeeatch on leai^ing 
and teaching and for development of self- instructional programs ♦ Coi^uters 
and cojnmunications are esp^ially ±ii?)ortapt because the training devices ^c^n 
be locate4'in public school classrooms, business offices and engineering shops 
or laboratories, through which an infiorination processing system can instruct 
answer questions, Meliver tests of understanding # record^ data, and 
hypotheses regarding instruction and learning with great 'detail and over long 
periodl ^tff^t^e. This ^apabi^llpy to introduce e^erlmental control ^nto 
Situations satisfy^in^ the real demands of education and training should hielp 
reduce the present discrepancies between contrived laboratory situations ^and 
actual applications of learning principles in training and education. ' \ 

. ' ' • ' - ^ ■ i • ; -'■ 

Research on natural language ^processing,, informtlon structures, and cottj^uter''* 
aids f or jiuman intellect, eventually will produce^ tools to augment considerably 
th^e resources available to authors of coi^uter-based exercises* ;How*ever \ 
it is very dif f i<^ilt to, anticipate the details of such facilities for 
educational ays terns, and it is not glear how -iA^^ instructional p'rograffla^r 
would write directions for generalised ^language processing or definition 0$ 
infonnation structures if today^s toolS| were put at his disposal. 

* , _ * ■ \ / • 

Special-put^decTonyuter programs can be written to^assemble instruction 
materials ^rom elements of a subject^^nd'relatioi* "tips mong these el^ssents* 
A programtner can describe an entire class of problems with one. set of cogyntefc 
statements (program) by which an indeflntie number of test or instruction 
items are generated for presentation to each student as they are needed, ^^For 
some learning exercises, writing a rule which generates sufficient, variety 
will be ri^ther difficult j if the number of exatrq^les needed la fairly s»ali, . 
the author will save tin^ by 'writing out each variation he needs to have 
available. However, even When the technique does not save ttoe in initial 
drafting, it will reduce the probability of oversight or error by the author 
coinposing the problem set. Furthermore, generati^ rules are likely to 



Jily 1971 ^ ^ : * ' Project CtUE 



t 



26 



^- I 3 Overview 




/ 



National Council for Educational Tifeislinology . Proceeding s of a Seminar on 
Coiiibu ter Based Learning Systems , John Annetc and Johft Duke ^ (eds ♦ ) . L ondon : 
National Council for Educational TechnoL j^^^-Hg.^ 1970. 9y pp. Available 
from Books for Schools i: d. Councils and EducatIon--Rtess L-d. , 10 Queen Anne 
Street, London WIM 9LB, England. / 

/ * 

Pierce, John R. , (cominit4;ee chairman). Computers in Higher Education; Rep ort 
o f the President *s^'Science Advisory Coinmlttee . Washington, D.C*: U-S. 
Government Printing Office, February 19^7. , 79 pp. p ^ 

Scheepmiker, B. and Zinn, Karl L\^^n?oria ^ Conference, on Computer s in Education, 
Sponsored by the In£eniattoi3LalFedeiration for Information Processing (IPIP) . 
Amsterdam: IFIP. /Distributed^6y>Si:ience Associates International, Inc, - 
New Yortc, N;Y* / 

Silberman, Henry F, and Robert T Fil^p. ''Information Systen^ Applications 
in Education. K Annual Review, Information. Science and Technology Vol. Ill 
C^i?4os Guarda (ed*). 
pp* 357^395 



Chicago: Encyclopaedia Britannica, Incorporated, 1968, 
Systems Enc^in^ering; of, Education VI: Principles of 




SilveriTK^Leonard C. 



Computer^Affsisted. Inat-ruction Syst^ . Los Angeles: Education and Training 



ConsultantsXompany>O.970. 1^ pp 



Weeg, G. P., (e^^. Prolcgedings of 
Undergraduate Curricula * Ib^a City 
488 pp. 



a Conference on Computers in the 



The University of Iowa, June 1970. 



Whinaery, John R,, (chdlrman) , Instructional Technology Committee of the 
ConjnissioA-on Education \f the Natl|onal Academy bf Engineerings Educational 
Technology in Higher Education: The F^i^iises and Limitations of ITV and CAI . 
Washington, B.C.: NAE, C**pnember, 1969. \22 pp^r " / 

21nn, Karl L» and Su^ McCiiritock. A Gulde^^to the LiWature on In teractive 
Use of Computer s, for tnstructloti , 2nd edition.'. Stanford: ERIC Clearinghouse, 
1970. 31 pp. " , r ' 



Zinn, .K?,r^ 1, "Computer Technorogy\for\ Teaching and Research on Instructiotlx*' 
Chapter 8^ pp* 618-34 in the Review -of Educational Researrh , Vol. 37, No. 5, ^ 
December, 1967. L— ^\ \ 



July 1971 



\ 



Proj€ct*:CLiIE 



1 



4. GUIDELINES FOR CURRENT USES 

On many occasions since the initiation of Project CLUE in 1969, the staff 
participated in discussions of guidelines and recommendations dealing with 
instructional use of computers* At each sucK opportunity the background 
materials and tentative findings of Project CLUE were introduced into, the 
proceedings of the meeting through written statements p^repared in advance 
and by participation in the drafting of recommendations on the spot. By this 
means of presentation, critical review and revision, the information and 
ideas were brought back to Project CLUE amplified and extended by the ideas 
of others not on the Project staff. 

This section on guidelines includes many proposals which also appear In the 
various sets of guidelines and recommendations produced by conferences and 
"sjnnposia in which the Project staff participated during the last two years. 
Among the most significant ones for Project CLUE* purposes are: a Unesco 
consultation on computer uses in instruction (March 1970), an NCET (UK) 
symposium on^xcomputeij-based learning systems, two OECD symposia on computers 
in higher education (March and Octobei^. 1970) and one on computers in secondary 
education (Ma^dh 1970) , a Rand Corporation meeting ^on computers in the 
instructional process (October 1970), the IFIP World Conference on Ccrmputer 
Education (August 1970), and three sessions of the ACM Special Interest Group 
on Computer Uses in Education (November 1969, May 1970, September 1970). A 
complete list of meetings and presentations is included in Appendix A of 
Volume II* 

The intended audience for the guidelines assembled here includes the potential 
author, user and manager of computer applications in the instructional process 
and, secondarily, the possible sponsor, whether a government agency, state 
office of education or the administration of an individual school or college. 
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A variety of positioiiH are represented In the guidelines selected from the 
position statements of Volume H ^nd other sources, Some apparent 
discrepancies among viewpoints can be accounted for by a difference in the 
time perspective, e,g,, how soba changes in institutions can be expected to 
occur. Other possible conflicts in priorities are attributable to the 
difference in the perspectives of research and development as contrasted with 
teaching and administration* 

The guidelines propose action by a number of different individuals and 

institutions. Although the agent of action should be clear from the context, 

a listing may be helpful here to indicate the scope: 

International organizations such as OEGD, Unesco and IFIP* 

Government agencies including education authorities, research 
funding agencies, and special commissions* 

Professional associations concerned with computer uses in ^ 
edtication and training, 

Gonsortiums of institutions or , individual projects* 

Educational 'institutions, considering administrators, 
teachers, and students. 

Individuals working on development of computer uses and 
related materials. 

The guidelines have been arranged in a listing of short statements grouped in 

^ive major categories: 

^ A* Management, operations and costs of computer usfes in 
instruction. - 

B. Development and evaluation of computer-based learning materials. 

G. Programming languages and implications for instructional 
strategy. 

D» Introduction of computer uses into instruction. 

E. Transfer of findings and materials from one project to another. 

References to the* related sets of recommendations are included at the end. The 
glossary in Appendix E of this volume may be helpful to the -reader unfamiliar 
with some of the technical terms used In the following guidelines. 
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A. MANAGEMENT, OPERATION^! AND 'COSTS OF COMPUTER USES INSTRUCTION 
■ 1. Requisite reorganization of institutions. 

A tremendous discrepancy exists between ultimate promise and the immediate 
possibility of computer use. In the long range, success of computer-related 
innovations will depend on comprehensive reorganization of the educational 
'system. The expected benefits of' individualization and information processing 
usually are not compatible with the traditional structures and methods of 
operation of most educational systems today, although they are quite necessary 
for meeting the demands made by rapid expansion of knowledge and discoveries 
made in science and technology* However, introduction of computer-oriented 
techniques-need not wait for refiTm; indeed, such changes might help bring 
about needed improvements. Optimizing apparent benefits in the stiort run can 
and should be balanced against systematizing the supportivf^ processes in the 
long run. 

2. Use ^of available, low-cost facilities. 

Many of the existing computer installations could- be used by schools lacking 
, their own facilities. ' Most economical access is by a batch mode of operation, 

that is, by assembling a i;^uiiiber of jobs to be done at the convenience of the 
- computer operator. Batch mode and standard programming languages can be used 
to aid in the management • of instructional resources or to execute programs 
which students have prepared as part of their course work. On-line, 
interactive use is sometimes only a little more expensive. In any case, use 
of spare time on a government, university i or commercial system should be 
contracted specifically to assure availability on an appropriate schedule for 
student use* ^ 

3. Priorities for educational computing systems, / ^ 

In the management of computing systems which operate in a multiple-access or 

time-shared mode, instructional users should receive priority by some 

processing scheme which recognizes and services some users first, or a 

schedule that dedicates certain hours exclusively to student use. Other 
management considerations include J 
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small and perhaps mobile systems" (jninicomputera) which, 
reduce or elijainate dependence on coimnimication' links; 

effective, preventive maintenance and a supply of plug-in 
components, especially for equipment at remote sites; and 

guidelines for common practices in programming and 
documentation to facilitate exchange of learning ma'terials 
^an^ procedures among different initiators and users, 

4, Interpretation of cost^ estimates* - 

Costs reported for development of learning materials or for student use ol,^ 
system time cover a broad range; no one datum can be generalized since it 
depends on goals, manner of computer .use, appropriateness of the computing 
system- used, skills and preferences of the author,' local personnel costs, 
' outside consultation, learning materials already availaible for the topic, 

and the method 6f accounting for personnel, depreciation, software development, 
maintenance, and QtKercostB which may tiot be explicit. The range of costs 
sometimes given (as in Volume II, Part 2) should not be used except as .a very 
general frameworlc for the immediate future. 

5* Means of cost reduction. / 



tany T,eans ^re avaiTabi^^o reduce the cost of computer use 

(>Lanneo lepiacement old with new hardware and software 
cqn figurations; 

use of special-purpose, low-cost terminals; 

adoption of educational p ogramming languages which provide 

greater economy in computer time. ^ 

coordinated work by two or more students at a terminal; 

vided projection or recording of the use of a computer by 
one student at a terminal for viewing by a group of 'students; 

selection of computer contributions which can be accomplished 
in the batch mode of computer use at much less expense, for 
example, generation of materials for use off the computer, 
or computation, iii support of simulation^games; 

and text processing which helps identify weaknesses in 
writing and expression. 
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6. Planning for future capabilities. 

In anticipation of future reduction in hardware costs, not only of terminals 
but also* of communications and computer processing, most development of 
curriculum materials and the logic or strategy of instruction should be 
conducted in a modular and hardware-independent way so that comp.onent parts 
of instructional software can continue to be used alone or in various 
combinations as hardware, configurations change.^ Decisions. to initiate r.esearch 
and development projects should not be deferred "because costs will be. 
considerably less in a few years; the costs of delay could be considerable, 
for example, hurried training programs and errors in the engineering of 
systems. The development of instructional software .and expertise must proceed 
if these essential tools are to be used effectively when the hardware and 
communications systems become economical? 
7. Fund 'innovation and transition into regular operations. 

Financing policies and plans should be developed and examined carefully since 
they have a very profound impact on the entire educational system. Financial 
commitment should be made for a sufficient- length of time to assure an , 
adequate test of an innovation. The sponsor should consider itself 
^ the major beneficiary of an Wucational prbject; the administrations and^, 
governing bodies of educa.tional institutions should view new instructional" ^ 
programs as ^investments in ^he'future, developing an important "natural resource." 

8. Provide training and incentives for needed staff, 

4 • " f 

It is especially important ' to .anticipate the implications of policies concerning 
^he recruitment, selection, training, and payment of staff. The success of 
technological innovatiorfs requires a multidisciplinary staff which includes 
s/ientific and technical personnel expert in analyzing learning situations, 
ssessing performance and training teachers as well as assembling computer 
hardware and software and managing applications. Existing educational^ 
institutions may not now provide candidates' in the full range of skills and 
experience necessary for the variety of roles to be filled in"a computer-related 
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instructional system. Salaries and related incentives shoiild be established 
to encourage the participation of the beat available teachers, technicians, 
and other professional andNDara-prblessianal contributors in innovative 
activities. Intelligence an^ creativity should be given greater consideration 
in selection of personnel tham years of experience. 



9, Assess value of change. 



Cost^ or cost effectiveness, in' the. short run is not the major consideration 
in a decision to introduce computersXinto the instruction and course 
development program of an educational^system. The extent and scope of 
desirable changes brought about as a ,reWlt of the introduction of computers 
and information processing certainly are worth some additional investment at 
this time in operations and in research/ and development. Development of 
new materials and techniques and the preparation of new teaches are 
particularly promising loci for efforts in educational reform. ^^^^^ 
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DEVELOPMENT AND EVALUATION OF COMPUTER-BASED LEARNING MATERIALS 

1. Establish a broad context for review. 

Development of computer-related materials should be pursued in the context 
of the entire instructional system, and coordinated with materials developed 
and administered for other media and course components* A review and 
advisory board should monitor the entire development program on a periodic 
b^asis to insure the coherence of the total instructional program including 
the procedures and policies for evaluation of student performance and attitude. 

2. Determine goals and methods first. ' , ^ 

Analyses of objectives and instructional methods need to be made in relation 
to the characteristics of the students before the costs and benefits are 
considered. Alternative instructional configuration^ should be examined In 
th^ same frame o^ reference prior to a decision to use or extend a particular 
instructional innovation such as a computer-based interactive system (or any 
of the technical media) for large numbers of students. 

3. Balance analytic and heuristic approaches. 

The contribution of computer-mediated learning exercises to^ydie quality of 
instruction will be known explicitly only dJE observable outcomes are specified, 
measured, and interpreted. The engineering of instructional materials to meet 
learner performance specifications requires the use of well-planned cycles of 
development, evaluation, and .revision and is* understandably expensive. 
Approaches which depend on heuristics (insights, which may reduce the need -for 
detailed analysis and trial use) usually are less expensive; they are directed 
at producing learning environments oriented to practice and production rather 
than "guarant^ed"ins true t ion" packages of the analytic agpiroach. However, the 
development of a successful learning environment depends on the insight and 
dedication of its designers who must anticipate the motivation and skills of 
learners* Assessment of success depends on the Judgments of experts in the 
discipline and in education, since the designers have not made an explicit 
Statement of outcomes^ to be measured. 
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4. Select well-structuTed subjects for tutorial mode of computer use. 

Authors of substantial amounts of computers-based learning material using the, 
tutorial mode c^not afford the tijne to shfipe or tailor individually each line, 
of text of each frame for each kind of student, but must devise stylized 
procedures and content descriptions from which many individual exercises cart 
be derived automatically as needed for individual students. ThererforeV 
initial applications of the tutorial mode of use of computers on a broad 
scale will be developed readily only for well-structured 'subjects such as 
language skills and mathematics • 

5. User-oriented management* 

'^Computer system managers should focus effort on developing, testing, and 

0 

using instructional sequences and learning 'environments vhich proioDte 

♦ - ' * ^ ^ 

desirable outcomes. Constructing, operating, arid modifying the system. of 

hardware and software should respond to thirtieeds of users and not distort 

their objectives. Planning and costing curriculum components and arranging 

to amortize the cost over many students during a period of years are just as 

important as hardware planning, , 

6. Useful documentation, 

Docuifientation is essential to economical maintenance and effective use of 
instructional programs^ Guidelines for docxunentation, when widely adopted, 
should broaden the base of users of effective instructional programs. 
Do*cumentatlon itself should be evaluated and revised on the basis of trial use 
by test readers typical of those for whom the documentation is intended, 

7* Provide for expanded use of materials. 

Extending the base of users beyond one subculture is a much more significant 
achievement than translation from one computer language and system to another, 
Impor^nt considerations includes language and, idiom; cultural variables, in 
particular, attitudes toward teaching, achievement, inquiry and exploration; 
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and structures or procedures appropriate to knowledge "and learning. Local 
trial of materials and programs^ is necessaj^ and revision likely before 
computer-based learning materials can be used in another setting, 

8, Favor qualitative improvements over .cost reduction* 

A development effort can and should demonstrate that successive iterations of 
materials produced are^^continu^ly improving/by relative me^ures of student 
benefits. To invest development resource^ in pspudo-^scientiffei compari/sons 
with some hypothetical ''traditional** mjerthod is short sighted. The achievement 
of qualitatively different goals i^/more important at present than^ cost per 
hour of instruction time. 



9. User support. 



Distribution of non-cojaputer supporting services is a difficult problem, not 
only. /In regional networks, but also in connection vith local facilities which 
may ifeq^^ire^juyis^if to go some distance to obtain documentation, ^psychological 
distance of computing .centers from users has been sad^d to cause .more problems 
J:han physical distance. Training and ajssi&tance for remote users of computing 
^facilities sliould receive special attention now. Projects which put most of 
^their resources into systei? development may find they have elegaft software 
dpd communications which are unused*^ , ^ * 

lOy Development teams and interaction among individual contributors ,v * 

Curriculum development should be considered in the context of the ne^ds.and- 
contributions of different persons involved in 'the effective use of cojsputers 
for instruction: students, teacher^, scholars, and expei^ts from areas of 
supporting technology such as computer and information sciences, psychology, 
engineering and instructional technology. These persons interrelate as they^ 
interact with a common base o| knowledge and processes from which the student 
is to obtain some satisfaatoi^ representation or idea of the subject, being 
studied. 
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1». Assistance for autliors -lading s\tudents)r 

i 

Spe ial assistance" for curruulusj preparation may be provided to an author ot 
ltf.:iinlng materials through auL.m^i^d indexing^ retrieval and other information 
prodessiag^and special requests may be luade of him, for example, to docmnent 
carefully his material and procedure %?hich otherwise lie concealed wlthia 
computer memory. Similarly, assistance may be provided directly to learners 
who can usefully perform as "authors" reorganizing the information base ^ 
exploring new relations, and building up personalized files corresponding to 
individual representations of the- knowledge, . / 

12. Author incentives,^ . ' ^ „ 

Incentive systems must, be establxsted to encourage curriculum development and 
maintenance. Professional and> econoTsic rewards should^ encourage potential 
authors, of ten working with others an interdisciplinary. group, to develop 
instructional systems. Recognition of quality work should hh a factor^ In 
^df termination of promotion or other advantages. Economic incentives require 
establishing ot improving Copyright regulations for new media, including 
computer sof tware'l — * , 
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F. REFEREKi 10 RELATEt GUIDELINES A.N'D RECUMHENDATU^NS 

"Guidelines for Instructional Use of Computers" from a.Unesco Consultation on 
computer Assisted Instruction, taris, -t^B Ifercli 1970. EDS/KtTT/Cons . CAI-TM. 
This list oi guidelines for instriiGtianai use of computers «lch special ^ 
relevance to developing countries ^was prepared for Unesco officers, experts 
and consultants who will be invplved in future years in instructional projects 
with computer components. An adaptation^of fhe preliminary report appeared in 
the April 19/0 issue £ the ACM Bulletin o n Compucer Usss in Education. 

"Conference Recommendations" from the l-FtJM^orf^ Conference on Computer 
Education. Amsterdam. 24-28 August 1970. Klne selected recommendations were 
rc-s..'w.-j It- .-endfv sessicu 28 Aagust:T9 7t). and revised bv-the Recommt^ndations 
Committee i9 August 1970. The copy has ^een published in a number ot pla^:e«; 
u .... . mlt'.uent ^<urce is rh^ ACM Bul letin on Computer Uses in 

Education, October 1970, which also. Includes amment on that conference. 



{ » 



"Report of the Final Meeting Held on 2^ March 1970" from a Conference on the 
Use of Computers 'in Higher Education.^ Centre fox Educational Research and 
Innovation, OECD. P^ris, 19-21 MarchlJTO. CERI/CT/70.37. The summary 
document was circulated for information only on a restricted basis. Many of 
Che papers from 'the meeting are available from OECD. 

Report- of the Intemattonal Seminar on thti tls^ of Computers lo Higher 
Education, Pdrtiand, Oregon, 26-30 OctohfiX 1970. Summary of discussion and 
list of recommendations is being asse mbled by the Northwest Regional 
Educational Laboratory for distribution early irT.9 71 by the Centre for 
Educational Research and' Innovation o£-JECirr 
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''tif,niii^anc%f aaJ Jbjectlves uL Computer Science in Secondary Schools/' RepDrt.- 
ot a seminar on Computer Services in Secondary Education held at 5evres, 
9-U March TJ/U, Centre for Education Research arid Innovation, OECD. The 
suimnary and final- recommendations were distributell by OECDf f or tnfprmation on 
a restricted basis/ E>:cerpts relevant to computers in tae instructional 
process, appi:ared in the »April issue of the ACM Bulletin op Computer Uses tn 
Education, The full report was published in Computer Education , Ho, 5, 
June 1970, in the United Kingdom. 

."Computer Contributions to Learning and Ferformancef An Outline" from four 
concurrent disrcussions on the cui^puter^s rcrie in learning, November 20 at 
FJCC 1969. The intended V^^oduct was an improved outline for guidance of 
individual writers preparing the special progr^ mati^rials for the ACM 
annual meeting in September 1970. Copy appeared in r.he February 1970 issue 
jf t^ V ACM Bulletin on Computer Uses In Education . 

"Computers in Educatioji: Mechanising Ruxn|tns or Humanizing Machines." A 
^anel discussion and workshop at SJCC JO,. Atlantic City, May 6-^7, 1970, A 
preliminary report appeared in the June 1970 issue of the ACM Bulletin on 
Computer Uses in Education . Advance notes for the workshop appeared in the 
Agril issue, and a complete , report is being assembled for publication early 
in 19 7lV 

"Recommendai/ions for Action" derived from the subsector on the instructional 
process of the ACM annual meeting. New York City* 2-4 September 1970. 
Suggestions for further discussion and possible action by ACM members appear 
parts in the October issue of the Bulletin on Computer Uses in Education . 
^Background statements for the session appeared tn, the August issue. The 
complete proceedings of the Education Sector .of the ACM meeting is in 
preparation for publication al»out the middle of 1971* 
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7. Language flexibility 

The key to serving the variety of user needs may be adaptability, extensibilrCj^ 
or flexibillti;<., without trying to "produce a generai'-purpose author language* 
Adaptations in any author *s personal notation need to be made rapidly enbtigh 

) keep him working effectively, and the eventual execution v^ith mkny studen<s 
needs to be economical, Trans^^^iun may be through- programmers ral ler than 
automatic processors, especially if the procedural programs are small. 
Procedures can then be appried to large files of curriculum data pVepared in 
H format convenient for the subject ,e>ifpert* 

^. Frogr.am descriptions* / 

Documentation (according to/'"j>ublication" guidelines) facilitates preparation 
and revision of ins true tiorial programs, review by referees and ^potential users, 
and communication to programmers who are to implement instructional procedures 
and content in some other system and language. Natural language is, not the 
ideal mode for describing learning exercises; some formalization of language 
appropriately requires the user to reflect on what he Instructs the m^^chine 
to do. 



9* . Ilxploit interactive mode of computer use* 

. ' ' * ^ ^ * ^ / 

On--iine conversational use of computers is almost certain to be more costly 
than less glamorous means of access to information processing aids. However, 
the occasional user of \computers is mor^ li^gly benefit from the interactive 
mode of operation than experienced or frequent users. Programming languages 
and l^arnlpg exercises should be selected to take advantage of opportunities 
for the infrequent learner-user to carry on a dialogue with the system. For 
example, the learner should Xiael encouraged to test tentative ideas and try 
out possibilities,, knowing the system not only will permit such explorations, 
iJut twill help them to be successful. Suitable computer programs will keep 
track of loo^i- ends while the user Is sketching in ideas, accept details 
later* and provide an Immediate and lnt;erpretable reply when the user's 
instructions are ambiguous or incomplete* 
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10 » Develop probieni-oriented software. 

Creation of problem-solving environments, which should be distinguished from 
particular programming languages, is possible through the ua*e of specially 
adapted c onsnand -onvenricns and data stru'^tures. Computing resources ran be 
arranged ii* con\eni^iM\ task-orientad packages for use in solving problems 
and exploring siai ^ bases, as wexl as in non-specific, procedute-orlented 
languages* ihe drtiiicial distinction between batch and interactive processing 
should be eliminated. Many systems already provide convenient means to move, 
to the mode and terminal device most. suitaltle, and programming languages will 
provide further support for optimum use of hman time and computi^ig resources. 

11. Leave materials development open-ended. 

A currit ulun. development group should remain free of the constraints of 

specific languages even to the extent of avoiding the computer when the 
a\ iXi<it>iv isul tware. anu programmers cannot implement the ^^j^ant features of 
an instructional strategy. A software system should be^adapted to specific 
uses and users; the managers should maintain clear subserviences of language 
maintenance and system operation to project goals* 

12. Matching resources to needs and goals. 

One' general operating principle foF persons planning projects in this area is 
to select carefully among possible applications of computers those which best 
exploit the compu«^er role and to match computer contributions to the-real 
geeds of learners. At the same timej the developn^nt of information processing 
tools for iearnlz-'g can better, be pursued with a subject or discipline 
urjientatiun than within the special .urea ot instructional technology. 
Information processing and computers will be used widely in all subject areas, 
and these new tools for learning and performance will interact in an exciting 
way with new goals and means for educationi. 
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D/ INTRODUCi;:ON OF COMPUTER USES INTO IiNSTRUCTION 

1. Determination of local needs, and goals. ^ 

It is difficult, if not impossibl^^ for any group to design an instructional 
system without reference to tke particular goals, needs, resources, and 
conditions of the specific community which will use the system. Indeed ^ the 
personnel who will be responsible for the technical implementation of the 
system should take a major role in planning sessions from the beginning. 
Concerned personnel at all levels in an educational institution should guide 
the development of new resources for instruction to support the goals of the • 
institution and those it serves. 

2. User-^oriented manager. 

The person responsible for the planning, development, and operation of an 
inst:^tioL.-oriented computer system should understand students, the learning 
process, and the systems approach to instruction as well as technical matters. 
He should have available, on a continuing basis, the consultation of specialists^ 
in all relevant disciplines; but he should be given the freedom and responsi^ 
bility to manage in a decisive way to serve instructional needs over a] 
others. The convenience of student access to and use of technology she 
placed above matters of 'system .elegance and staff convenience. He should 
maintain a project staff which recognizes these priorities* 

3. Multiplying effect through information centers and training programs. 

Gpmputers and information processing techniques should be introduced in a way 
which obtains a multiplying effect the education system and on dissemination 
of knowledge. Crucial points for application of effort are information systems 
(such as libraries and vocational guidance, services), teachers, aad especially 
th^ trainers of teachers. The newl technology must be supported by the 
development and distribution of ne^?j knowledge resources, including information 
about the technology and its implications for teaching methods, learning 
strategies, testing procedures and multi-factor evaluation. Fellowships ar-^ 
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exchange programs should be used to develop expertise among those who may 
become leaders in local projects. Training programs at, all levels of , 
education should .introduce new concepts of and approaches to education 
through technology and in particular through domputers and information 
sciences. 

4. Relevant dimensions of use. 

In the selection o£ instructional uses for the educational program, planners 
must consider a number of salient dimensions ^s they interact with a particular 
situation; program or student control, extent of diagnosis and prescription, 
variety of information processing tools, amount of interaction, helping role 
of the computer, and the extent of restraints on expression and interaction. 
Selection must also be made among a variety of ^modes of access to computer 
systems (batch and on-line, alphanumeric and graphic, etc.). 

5. An ini.L rumen f ^f change. 

A new project should avoid the use of the computer merely as a medium , 
£ur delivery oi a let Lurt= or programmed text. Thife mode is quite prone to 
^igid application in an educational system and may preserve old practices 
(such as excessive emphasis on drill and recall of facts) rather than increase 
flexibility and student initiative. , The introduction of automatic information 
processing, flexible information structures, and convenient communication 
links, on /he other^and, is more likely than otuer technologies to faciittate 
innovation and change in education' Imaginative uses of computers will 
emphasizel general processes and problem Solving more than^speciflc facts 
and convektions. ^ 

6. Favorable teacher experiences. ^' _^ 
In order that new teachers will adopt a flexible and creative approach. ^ . 
breaking established patterns as a result of encountering computer use, they 

' should: a) find computer-related materials useful and effective in their own 
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Roger Levien (RAND Corporation, Santa Monica, California) is conducting a study 
of -the prospects for coraputer-assi&ted instruction in higher education for the 
K^rr Commission on Higher Education. The final report to be available in the 
fall of 1970 will review current trends for instructional use of computers «ad 
suggest guidelines for achieving appropriate use in college instruction* 

Andrew Molnar and Beverly Sher»«a h«y«. coflpiled U.S. Office of Education Sugyott 
of Cosyuter Activities , a volmie of r«i^rts, project abstracts, and a.lx 
appendices related to O.E* support of co«puter act^ivities in instructioh and 
research.. U.S. Government Printing Office, Washington, D. C. , 1969. A five-page 
sua»fry of the report appears in the April 1969 issue of Educational Technology * 

Robert Morgan reviewed the state of the ert for ERIC at Stanford with special 
attention to management applications of the computer In secondary education. 
His report^ entitled A Re view of Bducatiosial Applications of the Computer, , 
Including those in Instruction, Administration and Guidance j appeared in 1969 
and copies are available from ERIC, Institute for Communications , Research, 
Stanford, California 94305. 

r 

John R. Pierce was Chairman of the Panel which prepared Computers in Higher 
Education; Report of the Pregldent^s Science Advisory Committee (U. S. 
Government Printing crfice, Washington, D. C, February 1967). The report 
provides general recommendations for Computer use for teaching and student 
research in all curriculum areas. 



m- 



/ A text by Leonard C. Silvern reviews equipment, systems and strategies along*, 
with a presentation of his approach to course development, production and 
tryout. Entitled Systems Engineering ol Education VI: Principles of 
Computer^Asslsted Instruction Systems , it was published in 1970 by Education 

rand Training Consultants Company, Box 49899, Los Angelas, California 90049. 
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gaming, modeling and design arranged to provide active learning situations , 
fpr both student and teacher. 
■.12. Assistance with records of individual^lzed study. 
Management of records and materials, prefeply by students directly rather 
/ than through, teachers and administrators, /is a promising application. Any 
program ',f instruction which allows some /flexibility in learning approach 
and rewards student initiative x^ill require management of large files of 
records of student performance, and information about materials and learning 
exercises on an individual basis. Some projects have assembled files of such 
size and complexity that the computer is justfHed for' reason of economy, 
reliability or accessibility 6f benefits to in^vidual learners. 

13. Meeting special needs of students. 

Some students have special needs for whom the presentation of instruction 
(exposition or remediation) via the computer may contribute significantly to^ 
learning and favorable attitude. When a student lacks motivation or suitable 
orio.ntation to the ordinar^ self-instruction resources, the machine provides 
a gentle pressure to proceed ahd to respond it each point of the essential 
sequence of instruction. (Nevertheless, one wo-.ad wish to achieve for theie 
students sufficient independence of thought and suitable motivation to proceed 
with self-learning exp-eriences apart from computer tutorials.) For students 
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Lawrence M. Stolurow wrote on "Computer Assisted Instruction" for The Schools 
and the Challenge of Innovation (McGraw-Hill and the Cdtamittee for Economic 
Development, 1969). In this chapt-er he" elaborates on the various purposes and 
unique instructional modes or applications of CAI, the special' advantages of a 
CAI system, and the overall financial costs of computer-assisted instruction. 

A book by William R. Uttal. Real-Time Computers; Te chni que and Applications 
in the Psychological Sciences , (Harper and Row, 1967) includes a chapter 
titled "Computer Teaching Machines." In his discussion of psychological 
foundations and of types of computer teaching machines. Uttal emphasizes the 
unique contributions automated information processing systems can make by 
automatic generation of the steps in a sequence of instruction. In a 
forthcoming boob which will be published by ENTELEK in 1971, hw expands on his 
ideas for "generative;*, computer-assisted instruction (Uttal- et_al. , In press). 

John F, Vinsonhaier^at the Computing Center of Michigan State University 
maintains under the sponsorship'' of MICIS (Michigan Inter-tiniversity Committee 
on Information Systems) a computer-based file of an annotated bibliography on 
computers in education, printing new editions on demand. 

John R. Whinnery is chairman of the Instructional Technology Committee of the 
National Academy of Engineering's Commission on Education which published 
Educational Technoldgy in Higher Education; The Promise s. and Limitations of 
ITV and CAI . September 1969. The report provides an overview of the field and 
discusses the promise of educational technology, problems of higher education, 
~^Tbe prospects of future funding and the role of engineering schools inthe^ 
development of educational technology. -It may be obtained free of-chafp from 
the Commission on Education, National Academy of Engineering, 2101 Constitution 
^ Avenue. N. W, , Washington, D. C. '0418. 

ERIC f jj, a review circulated in 1965 and published in The Computer in American 

Education (John Wiley, 1967). Karl L. Zinn described computer contributions to 
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lacking essentia] skills and opportunities for learning from present day 
language laSoratories and group instruction^ the careful sequencing and 
additional response processing done by computer systems appears to help. 

14. Research on instruction and the development of instruction jnaterials. 

It is not ^necessary that the computer contribute to the learning of individual 
students; justification may be found in collection or analysis of data, 
opportunities for more complicated research designs, processing and summariza- 
tion of data for the designers of learning exercises, etc. The presently 
critical attitude toward CAI of a tutorial nature for ordinary students in 
schools and colleges should, if anything, encourage increased investment in 
research on instruction and learning. When the process of learning is better 
understood and soue models of instruction have been devised, tutorial use may 
become a significant tool in futiire computers-based educational systems* 

15. New information processing techniques* 

Diagnostic, tutorial, and ot^er aids to be provided individual learners 
should be explored. The application of findings in the computer science 
areas of artificial intelligence, natural language processing, and question 
answering systems should be pursued vigorously for the benefit of educational 

16* Primary of user needs and judgment of scholar-teachers 

A practical approach to computer use in the instructional .process is to make 
the information processing tools and data bases directly available to the 
learner and let complex human skills and Judgment take ove^r. A psychologist 
may prefer to engineer the stimulus-response chains and assess outcomes by 
objective measures* A reSsearch^oriented management might dive^rt operating 
resources into educational and. psychological studies of factors which have 
little effect compared with the advantages of time and structure obtained 
f rom^ reformulation of curriculum^ and the amplification of performance basfed 
on powerful information processing tools oriented to the subject of study #, 
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A computer scientist raigat divert attention from educational goals and 
instructional procedures to tlut attractions of a particular technology. 
The scholar-teacber should remain in charge of tLe introduction of computer 
technology into the teaching and learning activities, attending to uses of the 
computer in his area and study, and to the advice of experts on technical 
matters of system limitations, new information processing capability, 
parameters of^ man-machine interaction, reactions and performance of individual 
learners, etc. 
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E. TRANSFER OF FINDINGS i\NIT MATERIALS FROM ONE PROJECT TO ANOTHER 
1, Project documentation. . 

^ M *e t H^-. .1.1 ptv'iu^t' de:4iltJ dcioumentation which exposes the .weaknesses 
(as 3 varning to others^ as we] 1 aa reports the successes of the effort (aB 



;rageme.r; t j rar b ? : Jc^4^-iSt-xlTe"^v^^ reports tor use in other situations 

shouid anticipate and 'try ta^. reduce the confusion which often results from 
terms and examples sp^^tific to the local culture and conditions, I'Jhen the 
equipment used. is not^ generally available, the application can be described 
by procedures which might be adapted fcpr use on other equipment. 

2. Materials documentation. 

One part of the documentation of a successful project should be» a detailed 
and objective model for the process of innovation and change regarding \^ 
computer contributions to teacher training, materials development, and 
direct instruction. This model should be sufficiently specific to pr:ovide 
the basis for various computer-based simulations of conditions and outcomes I 
characteristic of many situations, and thereby contribute to the objective 
planning of other projects. 

3. I)istribution of new materials and research findings. 

Authors shouid be provided greater incentive to document, distribute, and 
revise computer-based exercises. Potential users cannot choose wisely without 
mure complete information, reviews, and evaluative studies. Curriculum 
development resources and training programs at regional centers would help to 
diffuse common practices and increase likelihood of exchange. Competing 
curriculum packages will be distributed through different time-sharing 
services, and decisions based on quality and economics will be made in the 
marketplace. 

^ \ V 

I ^ \ * • - 

1 ^ . 

I • 
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4. Guidelines, for broadening the base of users. 

Means to achieve wide use of effective learning exercises have been suggested: 
formalize and standardize procedures of journal review and dissemination; 
issue a periodic review of computers in education^ provide better incentives 
to the author, e,g,, academic credit, copyright protection, and reimbursement; 
improve documentation of learning exercises. 

5. Contribution of professional societies. 

If institutions, particularly colleges and universities, are to effectively 
introduce computers into teaching and learning activities, professors *must 
feel they have the support of theit departments and administration. A \ 
favorable attitude toward effectiveness may be achieved through reviewing 
activities and other programs of professional societies* 

6. The role. of publisher and manufacturer, - • ' - 

The trust and cooperation necessary between educators and manufacturers is 
4ifficult to achieve since the educator *s open environment and tradition of 
free exchange of dataware contrasted with the manufacturer's concern for 
protecting^proprietary information and/or not releasing defective products 
too early. Cooperation between universities and indtistry in the production 
of programs s almost essential. 01 course, the major responsibility for 
what Is offered will continue to be with the publisher and author rather than 
with ndrdwait- manulaclurers ♦ 

7. Rotation of personnel. 

^flien possible, prospective personnel for a project planned at one site should 
work for, a time at^nother site which is already operational. Furthermore, 
the start up of the new project?^ should be aided by short-term participation 
of personnel selected from the other site where the regular staff received 
some training. The new site in turn^ill help other schools and colleges .to 
establish new activities in the computer-related area, A chain for communica- 
tion of experiences then branches out like a tree. 
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8. Mobile team of experts. ' . . > "' „ 

Ideally, a government ageacy or foundation -concerned about econpmicail and 
effective establishment of new projects at many sites Cschopls and colleges) 
would help establish a team of experts which could moVe from place to pllce, 
carrying the experience from one high school or 'community college to another - . 
(along with persons who move from a training 'site to their home institution 
as -indicated' in guideline -Jb) . 

Demonstration facilities. 
A few sample programs, demonstration systems and portable terminals should 
be available for trial use by any institution considering the establishment 
of a new program. Complete resources could be installed temporarily at the . 
•site including consultants available locallyt or persons from the institution 
should be able to go'" to anothS institution or a regional demonstration center 
for training, trial use atid,ma^itials development. 

10. Source of information and consultation. 

A non-commercial clearinghouse could complfment the work done by profit-making 
ventures to provide materials and programs, information about equipment and ^ 
software,, etc. This clearinghouse oir. national lnformation center would main- 
tain' a list of sources of in^brmation and service, including individual 
consultants perhaps, available at minimum cost throygh the service programs of 
prbfessional societies (e.g., ACM and AERA) . It should coordinate efforts with 
similar centers^in other countries through international organizations such -as 
IFIP, Unesco.and OECD. 

11. Conferences m lompuLers in education. 

Regular conferences should be held, some of them quite general and others^ 
speciiic !u .a-ea.^ ui' i.auu»6 to components M the i^chnology. Ail levels 
a^idlTuTds H ^-cjw^ti-n shjuld b^ represented:" elementary, secondary, coJlegR. 
technical, prof essionai , on-campus, and- extended education in the home or plac( 
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iwork* Participants should include students as well as teachers in the 

I relevant disciplines, and alsq pctenciaX employers, union officials, agency 

1 representatives and others who may be served by education and training 

i 

j invo Iving , computers . 

1 12, Roster for international exchange, 

i 

jA file of , resumes and job descriptions should be circulated to encourage 

: bringing expe^rt staff from other countries wlio_wish to spends som^riige 

Ithe U.S. and to Increase opportunities for U,S; p*-ojects* staff to study 
I abroad. 
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Pr-^cuedin^s Qt a bomlnar on Computer Based Learnjjig Systems , Leeds Unifersity, 
5-10 September 1959. The proceedings was edited by John Annett and John Duke, 
and published by the sendnar organizer, the National Council for Educational 
Technology, London, 1970. The report records five days of presentation and 
discussion on the role of computers in education. Copies ;aay be ordered from 
Books for Schools Limited, Councils and Education Press Ltd,, 10 Queen Anne 
Street, London WIM 9LD. 
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GUIDE TO INFORMATION SOURCES 



Brief descriptions ar^ arranged for quick identification pf a source for general 
informatica about computer contributions, inatructionai technology and 
administrative matters, or a source for applications wifhin a specific subject 
area such as music, mathematics or medicinj^. To facilitate browning as well as 
direct search, the appendix is divided into four sections* 



1. 



Literature Surveys, Reviews and Bibliographies 

(Brief annotations of about 30 items arranged alphabetically by 
author; a list of general sourc^es for the educational administrator 
or teacher; background material for a, researcher or student.) 



/ 



Meetings, Conferences and Symposia (1961 -^J,SJjO->- 

(Selection of about 35 meetJjigs--Tl5ted^^i, chroni^^ order to 

indicate the development of this means of exchange of^ information, 
and to suggest new sessions which may be useful; also a guide to 
proceedings and background papers which supplement those 
publications listed in Section 1.) 

Bibliography for Sections 1 and 2 



X3 



3. Professional Organizations, Publishers, and CoBaaereial Information Services 18 

(Names and addresses of about 35 organizations with brief description- 
of the nature and frequency of their publications or workshops and 
charges; Indication of the number and variety of periodicals available; 
basis for selection of periodicals by individual readers.) 

Sumiuary of Periodicals 2^ 

^bout 25 publications arranged by the major user audieace (computer, 
^educatl^cr, -psychology, administration) and labelled by type (newsletter, 
bulletin, magazine, journal) ^ suggests areas for new publications.) 

4. Publications and Planning Groups Oriented to Various Subject Areas 29 

(Sampling of information so.urces in about 30 subject areas grouped 
by humanities, behavioral and social sciences, mathematics and 
physical sciences, and professions; indicates the extent of computer- 
related activity in some discipline-oriented organizations; suggests 
a starting point for 3 -eating information on the ia^tructional use of 
coaputers within each xield.) 

The set of information sources in this appendix is not complete and some errors 
may exist in the hrief descriptions; current and complete information should 
be obtained from the organisations listed* 
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0. Dennis Barnes selected 113 articles and other works from over 40 journals to 
include in Computer Assisted Instruction Annotated Bibliography** citing 
documentation of systems, programs and research activities. It was published 
by Phi Delta Kappa, Inc. ,^ Bloomington, Indiana, in September 1968* 

Don Bushnell, R» de Mille, and J* Purl collaborated on '^Educational 
Implications oH Technological Change," Vol* IV, A Report Prepared for the 
^Jational Commission, on Technology, Automation and Economic Progress, February 1966, 
Published by U* S. Government Printing Office in 1967. 

The ConanissSDn^on Instructional Technology, appointed in March 1968, issued a 
report in Match 1970 entitled "To Improve Learning: A Report to the President 
and the Congress of the United States/* The Commission was concerned with all 
aspects of instructibnal technology; its report makes recpmmendations and 
suggests priorities for federal involvement in instructional technology. It 
is available from the U. S. Government Printing Office at $,50 per copy* 



A 'bibliography and KWIC index was published by Gerald Engel in 1967 and re- 
vised in 1968 and 1969.-(Programming' Systems Branch, USNWL, Dahlgren, 
Virginia 22448). A third revision is currently in progress and. publication 
is expected by the end of 1970. It will again be available through USNWL* 

John' Feldhusen presented Interpretive reviews of recent developments in an 
article in Educational Technology and a" longer one in Con temporary Education , 
both published in ApVil 1969. A position paper on CAI Research and Develop- 
ment vas issued as a Series Two Paper from ERIC in February 1970. Available 
from the Institute for Comnunicatibn research, Stanford, California 94305* 

Wallace Feurzeig made a survey of instructional' uses of computers with 
examples for the Kettering Foundatloi^x entitled "Education Potentials of 



Computer Technology,** 1968, Bolt Berariek and New[man* 
Center #1672. 
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Silberman, Henry F. and Robert T. Filep. **Inf ormation Systems Applications 
in Education," Annual Revie w of Information Science and Technology Vol* III 
Carlos Cuarda (edO* Chicago? Encyclopaedia Britannica, Incorporated, 1968. 
pp, 357 - 395. 

Silvern, Leonard C. Systems Engineering of Education VI: -Principles of 
Computer-Assisted Instruction Systems * Los Angeles: Education and Training 
Consultants Company, 1970. 179 pp* 

Stolurow, Lawrence M. "Computer-Assisted Instruction,*' The Schools and the 
Challenge of Innovation * New York: McGraw-Hill, 1969, pp. 270 - 319. 
Also issued as Supplementary Paper No. 28 of the Committee for Economic 
Development, Subcommittee on Efficiency and Innovation in Education. 

Stolurow, Lawrence H* , Theodore I* Peterson and Anne C* Cunningham, (eds.). 
C omputer-Assisted Instruction in the Health Professions; Proceedings of a ' 
Conference at the Harvard Medical School . N^wburyport, Massachusetts: OTELEK , 
1970. 258 pp. 

/ 

University of Oklahoma Medical Center, Conference on the Use of Computers in 
Medical Education: Proceedin gs* Co-sponsored by the Department of Health, 
_5ducaUon_and Welf arAj'^iidJ^^^^ Oklahoma Medical ^Center. Oklahoma 

City: Unijyersity of Oklahoma Medical Center, April 1968* 105 pp* 

Uttal, William. "Computer Teaching Machines,** Real-Time Computers: Techniques 
and Applications in the Psychological Sciences > New York: Harper and R!ow^ 
1967. p. 234 - 269* 

Viavant, William, (ed.)* Computers in Undergraduate Education; Proceedings 
of the Conference in Park City, Utah , 2 vols. /Sponsored by the National 
Science Foundation. Park City: The University of Utah, 1969, Vol, I, 249 pp.; 

Vnl . TT^ ^f^^ pp. . ^ 
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1967 and again in 1968, drawn from the files of the Entelek indexing and 
abstracting service. The October 1968 version is rather comprehensive and 
gives appropriate attention to research reports and documentation of 
instructional materials which have been prepared. Through Entelek, Hickey 
also publishes the CAI Guide. 



Donald Holznagel publishes periodically a Computer Education Resource Catalog 
for the Computer Instruction NETWORK, 4924 River Road North, SalemJ^Oregon 97303. 
The catalog includes a serial bibliographic listing of books, pamphlets and 
periodicals in general categories according to their major content or purpose, 
an annotation of some works, and a listing of films and reviews. 

Max Jerinan prepared ^ report on "Characteristics of CAI Configurations from an 
Author's Viewpoint" which discusses tfte^capabilities and limitations of 
existing CAI system hardware ji particu^fly terminal devices for instructional 
use* The report was given at a conference in September 1968 arranged by the 
National Council of Teachers of Mathematics and Penn State University, and 
published in Computer Assisted Instruction and the Teaching of Mathematics 
(NCTM, 1969). ^ 

{ 

Manfred Kochen wrote a survey of "Information pclence and Computer Aids in 
Education," for the 6th Annual Colloquium on Information Retrieval, Medical 
Documents Service, Philadelphia, May 1969. He describes current progress In, 
three inter-related areas: computer-aided instruction, computer-aided 
question answering and computer-aided informa^tion retrieval. The paper 
appears on pages 209-220 of the colloquium proceedings, The Information T 
Bazaar , edited by L. Schultz. 

r 
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Zinn, Karl L'. (a)- . "Computer Assistance for Instruction: A Review q£ 
Systems and Projects,'' The Computer in American Education , Don D. Bushnell 
and Dwight W. Allen, (eds.)* New York: John Wiley and Sons, 1967. pp. 
77 - 107. . . ' 

Zinn, Karl L. (b). (Comparative Study of Languages .for Programming Interactive 
Use of Computers in Instruction , Final Report. CNR Contract NOC014-68-C-0256. 
Boston: EDUCOM, ,1969. 225 pp. 

Zinn, Karl L* (c). An Evaluativfe Review of Uses of Computers in Instruction 
(Project CLUE), 2 vols. August 1970. Final ropy December 197U 

, Zinn, Karl L. and Susan HcClintoclc. A Guide to the Literature on Interactive 
Use of Computers foi Instruction » 2nd edition. Stanford: ERIC Clearinghcuise, 
1970. 31 pp. 
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The Second Edition of "A Guide to the Literature on Int>eractive Use of. 
Computers for Instruction" has been prepared by Karl Zinn and Susan McClintock. 
Issued by ERIC in January 1970, it describes various uses of computers in, 
instruction, types of lessons, systems and computer languages, existing 
literature surveys, meetings, conferences and symposia which have been held, 
professional organizations, publishers and commercial information services, a 
glossary of common terms and a list of individuals responsible for development 
and demonstration projects. If is available free of charge from the ERIC 
Clearinghouse, Stanford University, Stanford, California 94305% 
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2. MEETINGS, CONFERENCES AND SYMPOSIA (1961-1970) 

^ • 
The sources which follow are organized chronologically by date of occurrence. 
In addition to the publications and proceedings which were an outcome of the 
meetings held, the references may also assist the reader by suggesting where 
to look for materials resulting from meetings or conferences to be held in the 
next year or so. Regularly scheduled conferences (FJCC, SJCC, AERA, AEDS, and * 
/ ACM) are held annually or bi-annually and generally have conference proceedings 
available (see Section 3). 

John Coulson of System Development Corporation (SDC) edited the proceedings of 
the October 1961 Conference on Application of Digital Computers to Automated 
Instruction, sponsored by SDC and the Office of Naval Research. The 
proceedings were published in a book entitled Programmed Learning and 
Computer-Based Instruction (John Wiley, 1962) • 

A conference was sponsored by AEDS and Stanford University on uses of computeirs 
in American education in October of 1965* Sections of two of the presentations- 
appeared ±ti Saturday Review 1966 and the conference report The Computer in 
American Education was edited by Don D, Bushnell and Dwight Allen and 
published by John Wiley in 1967. 

A conference on the Computer in American Universities was held at the 
University of Cali-fornia at Irvine in November 1965. , Tae contributed papers 
were published in 1967 with a transcript of discussipn (Computers and 
Eduction, edited by Ralph Gerard, McGraw-Hill). 

— The Commission on College Physics (CCP) also sponsored a conference In 

November\l965, at Irvine. The report of- that working session, The Computer 
in Physicte Instruction , is no longer available from the Commission at the 
University of Maryland. It will be replaced by a greatly expanded Conference 
Report of the Conference on Computers in Undergraduate Science Education 
sponsored jointly by the CCP and the Illinois' Institute of Technology, to 
be held in Chicago in August 1970. The purpose of the second conference '1^ 
to consolidate the body of existing knowledge on the uses of computers in 
education, particularly i'l^physics and mathematics, and to aid in the 
dissemination of knowledge regarding recent advances. For [information 
contact Ronald Blum, CCP, 4321 Hartwick Road, College Park Maryland 20740. 

In March 1966, the Office of Naval Research CAI interest group met in 
Cambridge at Bolt Beranek and Newman and at Harvard University Computation 
Center. (ONR supported many of tl>e innovative projects in this area, and 
through. Entelek, encouraged meetings to exchange information.) Participants 
discussed CAI languages for both students and authors, A summary was 
distributed by Entelek arid appeared in Automated Education Letter . In July 1966, 
Educon established an informal working group in the area of author languages* 
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Also during July 1966> Educom assembled a number of experts and representatives 
from meinber institutions to discuss and plan a network for communication among 
colleges/ and universities in North Axaerica. The report of that conference 
detailed designs and projections of need and probable uses for network 
services. Hie report was edited by Brown, Killer and Keanan, and published in 
July 1967 by John Wiley under' the title EDUNET, 

In August of 1966 and 1967, educational technology and special equipment were 
described and demonstrated at a conference of the American Management 
Association (AMA), 135 W, 50th, New York, N.Y. 10020. The conference programs 
describe topics and participants; no summary of the sessions has been published, 
AMA Conferences on Education and Training were held in August 1968 and 1969,. 

The ONR CAI Interest ^roup met at System Development Corporation, Santa Monica, 
California, in September 1^66. Various SDC programs exploring computer aids in 
educational systems were described, and participants discussed issues related 
to successful iGq)lementation of CAI. A summary of these sessions is available 
from Entelek; sections ,of the summary appeared in Automated Education Letter ^ 
January and February 1967.- 

A conference on computer 'assisted testing was held November 1966. Proceedings 
entitled "Computer Assisted Testing, Proceedings of a Conference" were, edited 
by Harmon, Helm and Loye at Educational Testing Service, Princeton, New Jersey, 

The ONR CAI interest group met at Pennsylvania State University in April 1967. 
Research and development activity in technical education using. an IBM 1410 
and experimental Coursewriter was described • A stimmary was distributed by 
Entelek. 

The Education Policy Project at George Washington University conducted a 
"traveling seminar'' for the Offi^:e of Education during July of 1967. The 
background papers, briefing sessions and conclusions of the seminar participants 
are presented in the final report titled Education in the 70*8 . Copi]es are 
available from the ERIC Document Reproduction Service, which lists it as 
document ED ,022 361. . 

An SSF^sponsored conference. Computers in Undergraduate Education: Mathematics, 
Physics, Statistics, and Chemistry, was held in December 1967. Panels of 
univerfity'faculty^w«e formed in each, discipline to discuss their views on the 
Impact which they believed computers would have on their undergraduate progrpzis 
and to make recommendations for future NSF activities. The panel reports and 
related discussions appear in the proceedings which may be obtained from tl>e 
Office of Computing Activitlef, National Science Foundation, 1800 G Street, N. W, 
Washington, D. C. 20550. 

\ 

An ONR interest group on simulation in instruction met at The University of 
Texas at Austin, January 1968^ Special attention was given to projects of the 
"CAI Lab at Texas aid the siamlations for testing and training at the Manned 
Spacecraft Center in Houston. Notes have been distributed by Entelek. 
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A conference on the Use of Computers in Medical Education was held at the 

University of Oklahoma Medical c|nter in April 1968. Sessions c6nsidered 
• ^ computers' in undergraduate, clinfcal, and continuing education, as well as 
■ their use in medical libraries, f The conference proceedings are available 

from the University of Oklahoma Medical Center, 800 N. E. I3th Street, 

Oklahoma City, Oklahoma 73104. . 

NATO sponsored a conference on computers and learning in Nice, France, in May 1968. 
No official proceedings are available, but informal proceedings vere 
distributed by the U. S. Of fice/of ■ Naval Research. 

Under sponsorship of the Nationai; Science Foundation's Office of imputing 
Activities, Stanford University, land the University of Illino?-, a working 
conference on systems design for computer-based instruction was held in 
Qolor'ado in June 1968. Emphasis was directed ^at 'discussion of hardware 
systems (design objectives and criteria), and at languages, teaching strategies, 
and sof tware ^for CBI systems- Notes of the conference are available from 
Dean Daniel Alpert; University of Illinois, Urbana, 

Pennsylvania State Univers^^ty held a conference on Computers in Mathematics 
( : , education in September 1968. The proceedings (edited by Ralph Heimer and 
* published by the National Council of Teachers of Mathematics, Inc., 1969)" 

' ' "included summary chapters by Max Jerman ^d Karl L. Zinn {see Section 1)^ 

William Viavant edited Computers in Undergraduate Education (Volumes I and XT) 
as the proceedings of a conference ^in Park City, Utah, September 1968. 
Published by the University of Utah in 1969, the work includes reports from 
federal agencies, the programs of the NSF, and transcripts of a set of work- 
^ shops on cur^icul^lm and programs, computers in engineering and science 

education, the social behavioral sciences and -humanities, facilities and 
resources and c6mputers in the liberal art^ college. ^ 

A conference on Computer-Assisted Instruction, Testing and Guidance at the 
University of Texas, October 1-968 was sponsored by Educational Testing 
Service and the Social Science Research Council* Specialists discussed the 
latest .research and theoretical developments, the state of computer-abased 
technology, and problems related to the implementation of such technology. 
^ Proceedings edited by Wayne Holtzman are in press for publication by Harper • 

' and Row, 1970. 

At a conference on Instructional Strategies Appropriate to 'qomputer-Assisted 
Instruction in Washington, D. C, October 1968 experts discussed the 
classification and significance of instructional strategies and operational 
definitions of individual strategies. Proceedings were edited by Albert 
HicV^y and published by Entelek as ONR Technical Report No* 9. 

n ■ r ^ : 
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*rr.e New York State Conference on Instructional Uses of the Computer took 
placesOctober 3-5, 1968, at Sterling Forest Conference Center, Tuxedo Park, 
New York 10987* The final report was published in 1968 by New York State 
Education Department and Northern Westchester BOCES, Yorktoi^ri; Heights , N,Y,, 1968. 

EDUCOM, in conjuact,ion witn the University of New Hampshire and with the assijstance 
of the National Science Foundation, staged a symposium entitled The Computerj ^ 
Utility — Implications for Higher Education held ix^ Manchester, New Hampsh^e, 
May 1969." A nummary of the symposium^s recommendat^ions can be found in the 
September 1969 is>ue of EDUCOM, The Bulletin of the Interuniversity Communications 
Council, Inc. (Volume 4, Number 3). The papers presented at the symposium have 
J)een incorporated. into a volume of the same name to be published in August 
1970 'b^rryr^ev-Healh & Co-, 125 Spring Street, Lexington, Massachusetts 02137. 
Editors are Michaer^uggan7"^^^i^^^^^^^ and Manley Irv^in. 

In September 1969, the t^ational (Council for Educationar"Technology,_160 GreBt 
Portland Street, London Wl,^elci a symposium at the University of Leeds on 
Computer Based Learning System/. Proceedings having the same title were 
published in 1970 and are ava/lable from Books for Schools Limited, Councils 
and Education Press Ltd., lO/Queen .Anne Street, London Wfe 9LD» NCET 
working papers and a feasibility study for a program for research and development 
were published in 1969 and/are available fr9.m tlie G^i^hcil offices* 

A Conference on Computer, Applications in Dental EJu^-atibn was held in San 
Francisco, October 1969, sponsored by the Professiorial Education Branch, 
Division of Dental Health of the National Institutes of Health. A summary of 
the conference can be obtained by writing to Dr. Luigi Lucaccini, Professional^ 
Education Branch of the Dental Health Center, 14th Ave. and? Lake Street, 
San Francisco, California 94118* 

The Second Annual National Laboratory for the Advancement of Education was held 
In Washington, D. C, January 26-28, 1970* It was sponsored by The Aerospace 
Education Foundation and the U. S* Office of Education. 

The Centre for Educational Research and Innovation (CERI) of the Orgarizatidn ^ 
for Economic Co-operation and Development (OECD) held two ;intematior j1 
seminars in Paris, France, in March 1970. The first, Comp.uter Sciences in 
Secondary Education, was called to discuss ,and make recommendations for the ^ 
possible content of a curriculum for this subject and the methods appropriate 
to teaching it. The second seminar. Computers', in Higher Education, was h§ld 
to consider CAI and other computer uses in college curriciila, and did nol make 
specific recommendations » The papers and discussion summaries of both sessions 
should be available soon from OECD-CERI, 2 rue Andre Pascal, Paris. 
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A sympuaium on Biomatbematics and CompuLar Sciences in the Life Science? was 
held'ia Houston, Texas, March 23-25, 1970^ to inform Investlgatow of re- 
seatrch,^nd applications of biomathematics, computer science, and bioengineer-- 
Ing in- theaife sciences and to provide a forum for the exchange of ideas 
concernips new research and applications. 

The .Computers and Design Conference was held April 20'-22p 1970, at the I 
University of Kentucky in Lexington to examine ,e effect* that high speed X/' 
information handling equipment has had upo^ the environmental design pro- 
fessl<5n. Proceedings should be available early in 1971* For infonsation^ 
contact Michael Kennedy, Chaitman, Conference Comimlttee, SchooJ. of 
Architecture, Pence Hall, Universl^x Kentucky, Lexington, Kentucky 40606. 

A conference on Computers in the Undergraduate Curricula. \^is held at the 
University of Iowa In June 197d with financial suppoW/trom* the National 
Science Foundation. The goal was to provide a nnp^ma^l forjim for the 
^esentation, discussi<m and dissemination of>i€aa> programs and other , 
cWicular materials dealing with the use^Ta computer In ^dergradyate 
edu^ion and to assess^ the needs fora^ntinuing national *lorum for study 
of com^H^er use in undergraduate cia:flcula» Preliminary Proceedings were^ 
distribufe^ at the .Coti£e2^nce|,„.±Mormation about the filial proceedings may 
'be obtain^^Nfrom g1 F. Wee^Otreetor, Iowa Regional Compute ACenter, 
W 17 E^st H^U>K ^lyiver^ty of Iowa, Xowa CltLy', Iowa 52240* T 



The Michigan' Department of Education and the I^ICOH Project sponsored a 
conlerence on GomputerN^Ppliwtions to Leamiiig July 8-10, 1910, in order 
to provide educational administrators with^askc facts concerning applications 
of computer technology to administrative and lEtstructional problems* For 
information on proceedings coht^act INDICaH Fro|iect, 1325 Creaceni: Lake Rnad, 
Pontiac, Michigan 48054. ^ 1 

In August 1970^ the Commission on College Pityaics and the Illinois Institute , 
of Technology held 4a Conference on Undergraduate Science Edmration* The ' 
prupose is to consolidate the body of existing knowledge on the uses of computer 
in^educacion, p rticuiarly in physics and math^ and to aid in the dissemi nation 
of knowledge regarding recent advances. It will replace the proceedings' cf 
the 1963 confer^ce (see page 7)* ^ For information contact Ronald Bltm^ CCP 
^i321 Hartwick^ College P^rk^ Maryland 20740. 

Tlie International Federation for Information Processing (IFIP) held 
World Conference on Compujter Education in Amsterdam, Tl\e Netherlands, In 
August of 1970* Three plenary sessions on current 'developments in computer 
education, educational technology and the impact of oompCters on society 
and education were followed by corresponding workshops and round tablp 
discussions* Prelisainary proceedings were distributed at the Conference 
and a final proceedings* Including soc^ record of discussion and recotsamndatiors 
will be published shortly aft'erwards* For information contact A. ^. Veenhuls 
StadhoudeKskade 6 * Amsterdam^ The Netherlands. 
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Feldhusen, John and Michael Szabo. "The Advent of the Education Heart 
Transplant: Computer Assisted Instruction: A Brief Interpretive Review, 
Contemporary Education , Vol, 40, No. 5, 1969. pp. 265 - 274. 

Feldhusen, John. A Position Paper on CAI Research and •Development. Stanford 
University t ERIC Clearinghouse for Educational Media and Technology, 1969. 
22 pp. 

Feurzeig, Wallace. "Education Potentials o£ Computer Technology". 1968, 
sponsored by the Kettering Foundation, Bolt Beranek and Newman. Defense 
Documentation Center ffl672.. 

Gentile, J. Ronald (b). "The First Generation of Computer-Assisted 
Instructional Systems: An Evaluative Review," Audiovisua j. Coramunleatxon 
Review . Vol. 15, No.. 1, 1967. pp. 23 - 53. 

Gerard . Ralph, (ed.). Computers and Education . New York: McGraw-Hill, 1967. 
303 pp. ■ ■ 

Harmon, Harry H. , Helm, Carl. E., Loye, Dav* : E. "Computer Assisted Jesting, 
Proceedings ot a Conferen'-'?" Educational Testing Service,. Prin. econ'. N.J. 1968 

Hansen, Duncan. "Computer Assistance with the Educational Process," Review of 
Educational Research . Vol. 36, No. .5, 1956. pp. 588 - 503. 

Heimer, Ralph, (ed.). Computer-Assisted Instruction and the Tea ching of 
.4thematics; Proceedings of a conference at The Pennsylvania State Univer sU^' , 
September 24 - 26, 1968. The National Council of leachers of Mathematics, 
1969. 152 pp. , ■ . 

Hickey, Albert E., (ed.) (a). Computer-Assisted .Instr uction: A Survey or the 
Literature , Third Edition. Newburyport, Massachusetts: ENTELEK, 1968. 89 pp. 

Hlckfry, .\lbert E. , (ed.) (b). Inst fuctional Strategies Appropriate t£ 
Computer-Assisted Instruction; rroceedings of a Conference . Sponsored by the 
Off ice of Naval Research, Techrxcal Report No. 9. Newburyport: Massachusetts: 
ENTELEK', 1968. 28 pp. ' 

Holtzman^lJayne. (ed.). Computer-Assisted Inst ruction. Testing and Guidance. 
New York: Harpe.r and Row,\in press. 

Holznag^tr-Oonald. Computer Education Resource Catalog . Salem, Oregon: 
Computer Instruction NETWORK, 1968., 45. pp. 

Jerman, Max, "Characteristics of CAI Configurations from an Author's 
Viewpoint," Computer Assisted Instruction and the Teaching of Mathem atics. 
Washiugton, D. C. : National Council of Teachers of Mathematics, 19(s9. , 
pp, 24 - 44. — . ' 
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Kochen, Manfred. "Information Sciences and Computer Aids in Education/' 
Th.fc Information Bazaar , L. Schuitz, (ed.). Philadelphia: Medical Documents 
Service, May 1969* pp. 209 - 220. 

Lekan, Helen, (ed.)- Index to Computer Assisted Instruction . Second Edition \ 
Boston: Sterling Institute, 1970. 295 pp. 

Levien, Roger, (director), RAND Corporation. Study on Current Trends for th e 
Instructional Use of Computers and Guidelines for Achieving Appropriate Use 
of Computers in Instruction . Santa Monica; Kerr Commission on Higher 
Education, in press, 1970. 

Lockard, J. David, (ed.). Computers in Undergraduate Education; Mathematics, 
Physics. Statistics, and Chemistry^ Proceedings of a Conference at the University 
of Maryland . Sponsored by th^ National Science Foundation, December 8-9, 1967. 
74 pp. Available from the Offici of- Computing Activities, National Science 
Foundation, 1800 G Street, N. W. , Washington, D. C* 20550, 

Margolin, Joseph B. and Marion R. Hisch. Educs: n in the 70*8, Final Report . 
Washington, D. C. : The George Washington University, 1967* Grant No. 
DEC 2-7-070400-28n- 326 pp* 

Molnar, Andrew R. and 'Beverly Sherman. U. S. Office of Education Support of 
Computer Activities > Washington, D» C. : U. S* Det)artment of Health, 
Education, and Welfare, Office of Education, January 1969* A five page 
summary of the, report appears in Educa ti onal Technology , Vol. IX, No. 4, * 
April 1969, pp. 5 - 9. 

/ 

Morgan, Rob'^^^t. A Review of Educational Ap p lications of the Computer, 
In cluding I ^ in Instruction, Adminlgtration and Guxdance * Stanford 
ERIC Clearingiir se, 1969* 12 pp^^ ^ ' ^ 

National Council for Educatio;rial Technology. Proceedings of a Seminar on 
Computer Based Learning Systems , John Annett and John Duke, (eds>)* London: 
National Council for Educational Technology, March 1970, 99 pp. Available from 
Books for Schools Ltd., Councils and Educate m Pres-^' Ltd,, 10. Queen Anne 
Street, London WIM 9LD, ^England. 

Pierce, Joha R* , (chairman). Science Advisory Committee. Computers in 
Higher Education: Report of the President's Science. Advisory Commlttes . 
Washington, D. C. ; U. S. Government Printing Office, February 1967. 79 pp.' 

Scheepmake/j B. and Zinn, Karl L. Preliminary Proceedings of the World 
- Co nference on Computers in Education ^ Sponsored by the International Federation 
for Info~nnation Processing (IFIP). Amsterdam: IFIF. August 1970. 
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American Federation of Information Processing Societies (AFIPS) , 211 E, 43rd 
Street, New York, N, Y.. 10017, The Fall -Joint Computer Conference (FJCC) 
and Spring Joint Computer "inference (SJCC) include sessions relevant to 
instruction, but often under such headings as system design, programming 
languages, and natural language processing, as well as under computer-assisted 
instruction. The Conference Proceedin gs of FJCC and SJCC are published by the 
AFIPS Press at the time of the meetings (usually November and April) ; before 
19^69, proceedings were published by Thompson, Spartan and others, ^ 

American Psychological Association (APA) » 1200 Seventeenth Street, N. 
Washington; D. C* 20036, Educational Psychologis?: ±u the official newsletter 
of Division 15 (Educational Psychology) and is published three or four times 
a year. Cori3spondence and contributions should be directed to Richard E. 
Ripple, Editor, Division of Educational Psychology, Stone 'Hall, Cornell 
University, Ithaca, New York 14850. Subscriptions are $1,00 per academic 
year. 

The Journal of Educational Psychology is a bi-monthly publication which 
includes articles and reports associated with problems of learning and 
teachi-tig ($10.00 per year). Manuscripts and correspondence on editorial 
matters should be seat to Wayne H. Holtzman, Editor, iJniversity of Texas,'* 
Austii:, Texas 787 10^ 



Association for Computing Machinery (ACM), 1133>venue of the Americas, 
Sew York, N. Y» 10036. A number of the monthly issues of Communications of 
the ACM include articles on use of computers for instruction, , Often these are 
concerned with the training of computer programmers, technicians and users* 



The Education Editor is Peter Wegner, Department of Applied Mathematics^^Brovm 
University, Providence, Rhode Island 02912 .\ Sections on programming laf^guages^ 
and computational linguistics occasionally are relevant to instructional \ 
programs ($20.00 per year). » \ ^^^^^ ^ 

The Journal of the ACM includes relevant ^material only occasionally, but^'x 
-Issues of C omputing' Reviews frequently have abstracts of technical reports an\ 
•papers from projects using computers for instruction, 

Computing Surveys began publishing quarterly in March 1969 as the surveyapd-- 
tutorial jouriial'^of the ACM ($7,00), ' ^ ^ \ ^ 

The Association has a Special Interest Group on Computer Uses in Education; 
the current chairman is Karl L. Zinn, 1315 Hill Street, Ann Arbor, Michigan 48104, 
A bulletin. Interface , is issued five times a year with membership at $4,00 
per year. It contains technical reports, material on the technical programs 
of ACM, and information about special meetings and wrkshops in the field of 
computers and education* The group also plans sessions for. meetings #of ACM ^ 
(August) and AFIPS (usually November Ind April). The Association >as 
num«rpus other Special Interest Groups and Committees which may be found 
under the specific discipline in the next section. 
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Association for the Development of Instructional Systems (ADIS) , C. Victor 
Bunderson, Chairman, CAI Laboratory, Sutton Hall, University of Texas, Austin, 
Texas 78721, and Helen Lekan. Secretary-Treasurer and Newsletter -Editor, 
Jnstructional Media Laboratory, University of Wisconsin - Milwaukee 
riUwaukee. Wfsoonsin .53201. APIS Newsletter , issued monthly, provides for 
the^' exchange of system programs and instructional materials among its members . 
($6.00^per year). The Association, which meets twice a year, startec as a 
group of IBfi 1500 System users. While it is now Qpen to users of any CAI 
equipment, mos^members are IBM users interested in Coursewriter and APL. 

Asso-ciatioji for Educational Data Systems (AEDS) , 1201 Sixteenth Street, N. W., 
Washington, d'. C. 20036.' AEDS Monitor , the magazine of the Association, is 
published 11 times each year; most material has been on data processing 
($15.00 per year). Material for publication should be sent to Dean D. 
Crocker at the Iowa Department of Public Instruction, Des Moines, Iowa 50319. 

The Journal of the Association of Educational Data Systems , published four 
times each year, includes many articles on computers and education ($10.00 per 
year). Bruce Alcorn is editor. ' '\ . ^ 

The annual meeting of the Association in March or April always includes 
sessions^on computers^^i Vtructioji,. A series of workshops on educational 
data processing held at vai^ous locations duHHg 1967-68 included sessions on 
CAI; proceedings are available from AEDS. 

Automated Education Center, P. 0. Box 2658, Detroit, Michigan 48231. Frank 
H Gille Publisher; The Automated Educa^oa Handbook ($35.00) and a 
npwsletter Automated ^Education ($18.00 per, year) provide information about 
programmed instruction, audio an^i visual media, and computer assistance. 
Most of the- material in the newsletter is selected from news releases and 
\ other publications 'for potential -educational users of computers, '.-e Handbook 
' incli'des research re^rts, pliscussion of procedures, and summaries of 
technology and applicatlons>*4iEC recently started a monograph series 
'Reprinting technical reports aryLLtytorial materials. , . 



Berkeley Enterp^rlses, 815 Walhington Street, Nawtonville, Massachusetts 02160. 
Edmund C. Berkeley, Editor and Publisher. Computers and Automation is a 
monthly journal; articles are' usually infotmal and descriptive. Sometimes 
information about a new project appears^ here before.it is reported more 
formallV. Usually each March issue carries a set of articles on Computers and 
Educatiffh"' ($15.00 per year). Berkeley also publishes books and monographs 
bearing on computers in. education. 

Berkeley and Computers and Automation operate-and maintain a PDP-y 
computer (made by Digital Equipment Corporation) using n^o^e than half a dozen 
interactive programming languages, including LISP, FOCAL, DDT, and EXPL. One 
!bof the main purposes of this installation Is research and investigation in 
learner-controlled computer-assisted instruction. 
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Computer-assisted Instruction, Inc. (CAI, Inc.) ,. Hi ^?es«, Monroe StreeL, / 
Chidago, Illinois 60603. Dr. Ro)^€rt C. Kyle, President. CAI, Inc. specializes 
in design, development and implementation of training systems. One-day 
seminars directed to business, industry, government and schools consider the 
present and future potfential .for use of computers in the educational and 
training process. Subscrii)tion fees. vary. 

Computer Decisions . See Hayden Publishing Company. ^ 

^ Computers and Automation . See Berkeley Enterprises. ' 

Computer Education Group, an affiliate of the British Computer Society and 
Schools Council Project Technology, c/o Chairman, North Staffordshire 
Polytechnic, Department of- Mathematics, Science & Computing, Beaconside, 
Stafford,- England. The two organizations Tcollabor^ate in the publication of the 
quarterly bulletin. Computer Education . Originally intended for readers in 
the United Kingdom, recent issues have increasing relevance for an international 
audience. The editor is B, Bo}*ker, Enfield College of Technology, Queensway, 
Enfield, Middlesex, England. n 

\ 

Datamation . See Technical Publishing Company. 

Data fQessine for Education , 1309 Cherry Street, Philadelphia, Pennsylvania 19107 
is a monthly newsletter (formerly published by the Automated Education Center). 
It "^iia^sses current and projected programs and publications in the field of 
computers in education of both national and international scope ($36.00 per year). 

Data Processing Magazine . See North American Publishing Company. 

Edtlcational Data Processing, Journal of . See Educational Systems Corporation. 

Educational Systems Corporation, Dr. Murray Tondot-:, President, Stanford 

P.O. Box* 2995, Stanford, California 94305. luls non-profit group publishes 

the Journal, of Educational Data Processing (quarterly), including articles 

on uses of computers for instruction, especially f^jr the te^hing of 

programmers and technicians. The Fall 1967, Spring 1969 and Summer 1970 

Issues are devoted to CAI. Alvln Grossman, is editor ($9.00 per year) . 

Educational Technology. Journal of . See National Council for Educational Technology. 

'''Educational Technology Publications, Inc., 140 Sylvan Avenue, Englewood Cliffs, 
New Jersey 07632, publishes books and monographs on the educat-ional use of 
computers as well as the monthly periodical. Educational Technology , which has 
one or more articles or notes^ on instructional use of computers in each issue. 
"The"T4arch 1970 issue is devoted to "The Computer and Education." Lawrence 
Li^JSitz is editor (^18. 00 per -year). % 

EDUCOM (Interuniversity Communications Couicil, Inc.). ^ox 364, Princeton, 
New Jersey, 08543. "llenry Chauncey, President. The central office dis- 
tributes a bi-monthiy puWlcation, EDUCOM , The Bulletin of the Interuniversity 

, Comnunications Council, without charge to the faculty of its 105 member 
institutions of higher education; ThCsBulletin is also available on a 

- subsSjtion basis\t no pdr year-^t%per year to educational institutions. 
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Needs in the area of computer uses for instruction are reviewed, along ^ith 
other topics J by panels concerned with technology and applications. A set of 
documents 0:1 programming languages and technical assistance for authors was • 
prepared m cooperation with the ''Center for Research on Learning and Teaching, 
University of Michigan. Copies of this comparative study of languages, 
partially funded by the pffice of Naval Research, aie available from Educom. 

The recently organized Educational Information Network' (EIS) is administered 
by Educom. Funded by USOE and NSF, EIK is developing a pilot network which 
will assemble directory and information services, recommend standard practices, 
and facilitate cost sharing of communication circuits- and special computer 
facilities for remote use or for Information exchange. 

Entelek, Inc., 42 Pleasant Street, Newburyport, Massachusetts 01950. Albert 
Hickey, President. Entelek conducts a CAI/CMI Information Exchange originally 
contracted for by ONR which periodically distributes abstracts of CAI and CMI 
research documents, summaries of operational CAI programs, and descriptions of 
individual CAI facilities. Five by eight inch data cards are mailed in 
multiple copies ,for cross-indexing and are accompanied by author,* subject, KWIC, 
and bibliographic Indexes. ONR originally -paid the costs for about 60 institutions 
active in. the CAI field and in the exchange; subsidy is no longer necessary 
and all participants now subscribe at $150 per year. Entelek Has proposed a 
new joornal called Computers in Instruction; William R* Uttal would be the editor. 

Entelek assists with CAI .interest group meetings, publishes summaries^ and 
distributes an occasional newsletter, entitled CAI/CMI Letter . The first 
three editions of CAI: :A Survey of the Literature , based on data in the 
information exchange, were published 1966, 1967 and October 1V68. The fourth 
edition is in press* Proceedings of the Entelek regional meet '^gs are 
currently in process and information on them may be obtained by writing to 
Sally Birch, Entelek* 

ERIC Clearinghouse on Educational Media and Technology, Institute for 
Communication Research, Stanford University, Stanford, California 94305. / 
The current report literature is indexed and abstracted in Research in Education * 
($21.00 per year, U. S. Government Printing Office, Washington, D. C. 20402), 
while journal litera**^.r^ is indexed in Current Index to Journals in Education 
($34.00 a year, CCM^^p^mation Corp., 9^09 Third Avenue, New York, N, Y, 10022). 

Supported by tpes^OT/lce of Education, it hasi been chartered Co collect, 
review and abstract publications and/doci* snts of importance in the variou§ 
media areas, lacludh»g--6q(^uter-^a$^d[L ted instruction, anfi to prepare the., for 
indexing and storage in a cOii^^J^^s^cces^ed datd base. While the Clearinghouse 
does not collect actual teaching materials, it does prepare and publish sumn*ary 
papers on the state-of-the-art in different parts of the field (see Feldhusen, 
Morgan and Zinn in Section 1). Documents are available from the ERIC Documents** 
Reproduction Service in^ Maryland in microfiche or photocopy, ,ERIC at Stanford's 
regular newsletter is free upon request. _ ^ ^ 
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Education and Training Consultants Co. (ETC), 12121 Wilshir^.^Boulevard, Los 
nngeles, California 90049 (Mailing: }5ox 49899, Los Angeles 90049). Dr. 
Leonard C. Silvern, President. Three-day to two-week training programs in 
'*CAI Systems'* and ^'Advanced CAI Systems** are presented in Los Angeles each 
February, July and November ♦ The samt ourses are given at various locations 
in the United States on a contract bas . This commercial orgapization publishes 
technical reports in the Systems Engi. ering of Education SerJfes, filmstrips, 
sound-slide presentations, CAI courses and news releases in the area of 
education, training and systems techniques. / 

Hayden Publishing Company, Inc., 850 Third Avenue, New York, N. Y, 10022, / 
James S, Mulholland, Jr. President: Computer Decisions is a monthly magazine I 
which includes -articles on information systems, automated processing and 
problem solving. Robert C. Haavind is editor in chief. / 

Tlie Institute for Advanced ^^Techr^ logy (lAT) , CEIR Inc., of the Central Data / 
Corporation, '5272 River Road, Washington, D. C. 20016. CEIR holds three-day 
seminars on Computer Assisted Instruction for those involved in education and 
trainini functions . No prior computer knowledge is necessary. 
> \. . ' 

' lostitute for Computer Assisted Instruction '(ICAI) , 42 East Court Street, 
boyl^^town, Pennsylvania 18901. Dr. Alex B. Kyle, President. This commercial 
organization ho^cis- number of conf eirences, meetings, training workshops for ^ 
instructional programmers, arid public one-day briefings each year. It plans /to 
publish an annual state-of-the-art review and also the CAI Newsletter (8 issues, 
$12.00 per y^ear) . . ^ ' ,x 

Institute pf Electrical and Electronic Engineers (IEEE), 345 E. 47th Street, 
New York, 'iN. Y. 10017. Proceedings of the IEEE occasionally is devoted . 
entirely 'to computeifs and related subjects,. The "last such issue was December 
which contained soma papers on computeir^aid^d instruction^ \ The November. 1967 
issue was devoted to computer-aided dejsign t$22.00 per y iar, single copy of 
special issues $4.00). IEEE Transactions on~^Man-Ma chine Systems (name changed 
from Transactions on Human Factors in Electronics)* IEEE .Transactions on 
Education and IEEE Transactions on Systems Science and Cyh^erietics often include 
relevant paper's^ A special issue of , the first journal, June 1967, contained 
eight articles focused on computers "and education. Subscription prices vary 
(single copy $5.00). 

Instr-^-tional Media Laboratory (IHL), University of Wisconsin — Milwaukee, 
Miiwa cee, Wisconsin 53201. Directed by Robert E. Hoye, the* laboratory is 
primarily concemtid with the University of Wisconsin System; nevertheless it 
prepares an Index to Computer Assisted Instruction now published by Sterling 
^Institute and fidited by Helen Lekan (see Lekan, Section J)- 
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International Federation for Information Processing, .6 Stadhouderska<Je 
1^ terda. 13. The Netherlands; Congress Of fice, 23 ^-f^/^fn'^o^tal technical ' 
England. Proceedings of the IFIP tri-annual congresses often cental.^ technical 
oaoers related to computer applications in educa'tion. Proceedings of the 1962, 
mS and 1968 congresses should be available from the North-Holland PubUshxng 
company! P 6. Box 3489. Amsterdam. Special meetings are held --^J-f .^^i^^^^ 
aHhe World Conference on Computer Education in Amsterdam. August 24-28. 1970. . 

The-National Association of Secondary School Principals (NASSP) , 1203 I6th 
ftree^ N. W., Washington. 0. C. 20036. '0-^/6 ^^^^''^^^^^^^^ 
■=lri- Education of the NASSP offered a series of seminars on potential uses of 
the, computer in vifioi^s parts of the country. Co-sponsored by Steri|ng 
Jnltitute the seminars included an explanation and actual use of CAI programs, 
in various curriculum areas, use of the computer in the classroom as a problem^ 
sdlving tool, exploration of CHI and IPl as well as exposure to and use of new . 
instructional techrfologies. The seminars are intended primarily for secondary 
rchool principris Registration fees from §115 to ^170 for a two and one-half^ 
day session. 



C, 



National Assnciatioa of Users- of Computer Applications to Learning (MUCAL). 
Mr. John Gratfe, Associate Director, Program Research ^nd Design, Cincinnati 
Public Schools. 320- East 9th Street, .Cincinnati, Ohio 1^5J02. This 
g\o-p was organized fay large school systems having CAI ^tojects. The i^itlax 
purpose was to present a defined, unified market to hardware and software 
vendors interested in CAI. Plans include a centralized dissemination of 
information on CAI tbjnembers. 

National Catholic Education Association, l.Dupqnt Circle, N.W., Washington, D. 
20036 The Association ^^Ushes/a calendar of all national and "Sular 
educational meetings each year. Entries give dates, places, tentative agendas, 
discussants, etc. (SO.. 80 per year). • , . ^ ^ 

National Council for Educational Technology (NCET). 'l60 f^^^^^^.^J^Jjf ' 
-London, W 1, England. The t.„^.i nf Rducational Technology is the official 

publication of the N^ET. It began publishing three issues per year in 
* January 1«>70. The petiodical is concerrfed priinarily with the theory, ^ 

appUcations .and development of educational technology ^J^^^^^^^^f °f ig^fo) 

included- editprials.- research ^orts and articles. ( 3£iOs per year or ^8.40), 

National Education Associati6n^T20^15th Street, N.M.. Washington, D. C. 20036. 
Aud iovisual fstruction is published ten times per y-^r by the Department of 
rdiovisual Instruction (DAVI) of the NEA. Material f o,:^ publicatton ^ho"" 
^ent to the editx,r, Ann L. Hyer ,($8.00 per year). The Audiovisual CoHmi»oit:atioag 
4evLw; publiahe^ Wrt..rly ly DAvf occasionally includes research -^^ta^and 
Ig?^ articles (§8.00 per yeafc). DAVI holds an annual conference ead, spring, 
tl^e 1971 convention will be held in Philadelphia from March 21 through 26. 
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National Society for Programmed Instruction^ Tr aitv rnivet&itv% 71b Stadium Drlv^* 
San Antonio^ lexal. 78212* The annual meeting ^usually is scheduled for April and 
includes sessions on instructional use of computers. KSPI Journal Is the oiiicial 
monthly publication of the Society (not published in January and August), ^Elaine 
Davis Is managing editor* Th^ journal contains articles on all facets "of 
InstrOctiouai progi:animing tiH-well as some newsnotes; computers are receiving 
increasing attention. Annual subscription Is $20.80 for non-*memb«rs ; $5,00. for. 
metabers- ' 

North American Publishing Co*,. 134 North Thirteenth Street , 'Philadelphia, * ^ 
Pennsylvania 19107, I* J. Borowsky, President. Data Processing Hagaalne is a 
trade journal that appears monthly* It contains a section on the use of. 
poinguters in education*^ Martin Nussbaum is editor* ($8*50 per year). 

tirganleation for Econo^c Co-Oparation and Development (OECD) Centre for' 
Bducatlonal Research. -^nd Innovation (CERI), 2 Rue Andre Pascal, Paris SVJe, 
France. Originally concerned with economic redevelopment of Western Europe,*- 
OECD is now focusing its atte^ion on social and educational proolems CERX 
is reviewing coifiputers and other technology for educational innovation* The 
proceedings of meetings held in March 1970 are' llltely to be availabio soon. 

[.System Development Corporation, 2300 Colorado Avenue, S|hta Monica,' Callfdrnl^-^ 
90406. SDC Haga^i^e (monthly) occasionally includes articles oi^ uses of 

computers for instruction, especially uses ±n systems training projects conducted 
by System Development Corporation* Available SDC pubilcatlon;^ are listed each 

.month Sn the last page oi the magazine. Dtecontlnued ih 1970, 

Technical Publishing Co., 94 So\ith Los Robles Avenue, Pasadena, California 91101 , 
fublisHes Datamation ^ edited, by Eobert B. Forest* This trade journal includes 
occasional irticles on the use of computers In* instruction. A special Issj^ on 
computers and education appeared in September 196ft. . ^Subscription inquiries sh,ould 
be directed to Datamation , 35 Mason Street, Greenwich^ Cpnneaticut 06830, 
Issued 24 ^mes per year ($25.00 per year). * - ^ * ^ ' 
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g^^g^^^^^^^^T^^ EDUCATION 
Newsletter: .news, announcements, abstracts 

reviewed before acceptance for publication) ■ \ ^ 



sometimes is indicated in parentheses in another column.* 
.;. c&IP ■': -Computer and infopmation. processing scientists and teachers,of 
' computer studiesi ^ , . *. 

E&IT : Educational and instructional technologists 
EP ^ : Educational psychologists 

Adm ' ; Administrators ' • ' - 



PERIODICAL 



C&IP 



EP 



Adm 



( 



^^^Communications''of Che ACM 

Computing Su^ryeys ^ ^ 

Bulletin of \the Special 
; Interest Group on computer 
uses in education 
(INTERFACE) 

Computer Education, 

"Datamatioii- 

Computers and Automation 



B/J 
J 
B 



B 
M 

M 



(B) 



•Data Processing Magazine 
Computer Decisions 



M 



M 



* Discipline orien ted periodicals that contain '"^^^^^^g 
instruccional use of' computers such as the Journal °f Jg ^f^gg 
Education or r.nrn pni-.e.'t's in the Humanitie s, are not included in this 
- table Th ey IFpear ih Section 3 which provides information on the 
educational iise of computers in specif ici disciplines^^ ■ 
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' PERIODICAL 



C&IP' 



E&IT 



EP 



Adm 



m 



lEEE 

Transactions on Education 

transactions on Systems 
Science anH Cybernetics 

Transactions on Han- 
Machine Systems 

International Jo&rnal of Man- 
Machine Studies ! 

EDUCOM Bulletin 

(Computer Contributions "to 
Learning and Teaching, 
pxoposed by Elsevier) 



J 
J 



ADIS Newsletter 

(Instructional and Learning 
^ ' Science, proposed by Elsevier) 

NEA * ^ f 
^ Audiovisual Instruction 

Audiovisual Communications 
Review ^ . 

Entelek CAI/CMI Letter 

(CAI Letter, proposed by the 
Institute for Computer Assisted 
Instruction) 

aft a^f^*^"-. ^ 

Automated Education Letter 

Data Processing Jor Education 

Educational Technology 

Journai of Educational 
Technology (NCET) 

NSPX Journal 



J 

(B) 

4 

(J) 

(N) 
(B) 



(J) 
B 

J 



M 
J 

N 
N 

J 
J 



(J) 



\ 



(J) 



ERIC' 
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PERIODICAL 



C&IP 



E&IT 



I App A Sources 
EP Adm ' 



AERA 

American Educational 
Research Journal* 

Review of Educational 
Research 

Educational Researcher 



J 

B 



i\PA 

Educational Psychologist^ 

Journal of Educational 
Psychology 

AEDS 

Monitor ^ 
Journal of AEDS 

Journal of Educational Data 
processing (annual special 
issue) 



(B) 



(B) 
(J) 

(J) 



B 
J 



B 
J 



( i 



\ 
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4. PUBLICATIONS AND PLAl.'NING GROUPS ORIENTED TO VARIOUS SUBJECT- AREAS 

Information lisced in this section specifies professional organizations 
which provide information or publish materials on the Instructional use of 
combuters in their field. Some of these organizations have been extremely 
active in providing materials and assistance to members wishing to utilize 
computers in their teaching activities; others- are only now realizing the 
importance of computers and recognizing their responsibility to disseminate 
information, org'anize working groups, ' minimize duplication, etc. 

A teacher interested in locating existing computer-based material for use in 
his course can consult various guides or indices such as those prepared by , 
Entelek and Sterling Institute (see Section 30. However, it would be of ^ ^ - 
considerable advantage to him if there were a library of these materials. 
and annotated listings within his discipline. Ultimately, such libraries 
should' include evalAiative critiques to assist th,e user in selecting the most 
appropriate materiars^for hig needs. .(See also Appendix C of Volume M on 
recommended programs for professional societies.) « ' y 

T^e materia], in this section does not^etail the a^'tlvlties of aH. profession'al 
organizations; rather, it is meant oniy*to indicate the extent of activity 
within a discipline orientation and the prospects for assistance to individual 
teachers from this -quarter. The section is intended as a preliminary guide to 
teachers and administrators \?ithin each discipline who may be unaware of the 

■ - - - ■ ^ /' 



specialized assistance available to them. 



Contents: 

1. l^umanities (page 30) 

a* General 

' b. Art \ : ^ ^ 

Languages and Linguistics^ 

d. Literature 

e. Music 

1. Mathematics and Physical Sciences 

, (page 33) 

' a. ^General 
/ b» Mathematics . . 

c. Computer Science 

d. Physics 

e. \ Chemistry 
. f. Biology - 

g* Geology 



3. Behavioral and Social Sciences (page 39) 



a. General 

b. Psychology 

c. Sociology 

d. ../Political Science 
"e. Geography^ 

f. History 

4. Professions (page 42) *j 

a. Architecture 
b« Business 

c. . Education 

d. Engineering, 
fc. Journalism 
f* Law 

-jg. Library Science 
■\ Medicine and Dentistry 
i. Social gork 
Urban Planning 
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Humanities 

a. General , 

^ 1. Organizations 

Special Interest Group on Arts and Humanities 
American Society for Information Sciences (ASXS) 
^440 Connecticut Ave., N*W., Washington D.C. 20036 

2 . Fubli!:ations 

Computers and the Humanities / = . 

Queens College of the City University of New York 
Flushing, New York 11367 ' f ^ ^ 

September 1969 issue contains proceedings of a two-day symposium 
at Queens College, May 9-10/^96$, "Humanities; Computers 69.-" 
I SpeTcific topics are covered in many other issues and articles, 
and the sections on "recent publications" and "book reviews" 
provide many ^ leads to other information 

Computer Studies in the Humilities and Verbal Behavior 
Floyd Horoxd.tz, Editor ^"'^ 
University -o/ Kansas * 
Lawrence, Kansas 

Boehm, George A.W., "New Graphics for Arts and Science," Think , 
March-April 1969, IBM^ Armonk, New:.Y<^ 10504 m-xi 

Bowles, Edmund A. (^.) Computers in Himanistic Research , 
Prentice-Hall, %Englewpod Cliffs, New Jersey, 264 pp., 1967. 

Presents short surveys of the use of computers in different fields 
q£ the htcnanities"_an3 social sciences. 

■ Sedelow, Sally Yeates,^ "The Computer in the Humanities and Fine * 
Arts," Computing Surveys , Vui* 2, June 1970* 

b. Art 

1. Publication ^ 

• Paquette, Russell, "Cybernetic Art: The Computer as Renaissance 
Man^" SPG Magazine, Vol. 12, No, 4, ^ril 1969, System Development 
Corporation, 2500 Colorado Ave*, %anta Monica, California 90406. 

c. Languages and Linguistics ^ 

1* Organizations ' 

Modem Language Association of America- 
62 Fifth Avenue, New York, N. Y. 10011 

^ACM Special Interest Group on Language Analysis and Studies 
in the Humanities^ (gIGLASH) > ' ^ 

c/o ACM National Headquarters , ' 

1133 Avenue of the AiefeLcas, Ne York, N.Y. 10036 , 
- ^ ^ * . SIGIASH Btdletin^ 5 Issues per year 
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ERIC Clearinghouse on the Teaching of Foreign Latiguages 
Modern Language Association - 

hi Fifth Avenue " 
New York, N. Y. lOOll 

Abstracts of^ documents on commonly taught languages* ^ . 

ERIC Clearinghouse oil' Linguistics 

'Center for Applied Linguistics 

1717 Massachusetts Avenue, N. W. ? 

Washington, D. C, 20036 

Abstracts-^f documents on linguistics and the less-taught languages. 

ERIC .Clearinghouse on the Teaching of English 
National Council of -Teachers of English 
508 South Sixth Street 
Champaign, Illinois 61820 

Abstracts of documents on English language and literature, 

'Other Publications 

Computer Studies in the Hxananltles and Verbal Behavior 
Flpyd Horowitz, Editor 
University of Kansas 
Lawrence, Kansas ~ ~ - 



Subscription address: ^ ? 

Coi$T>ter iStudies in the Humanities and Verbal Behavior 



Mouton ^ 

0, Box 1132 
The Hague, The Netherlands 



$10.00 per year , 



d. Literature 
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1, Publication * . ' . , 

- Calculi . ^ ^. , ' 

Stephen V. F." Waite, Editor ' , ^ 

Department of ^Classics . , 

J)artmouth College 
Hanover, New Jiaanpshire ^755 . 

Bimonthly newsletter Jealing with progress in the use of computers in 
classics, as w.ell as bibliography and news notes about conventions 
' and meetings. No charge for current isst^s . 
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husic 

1. Publications, 



Allvin Raynold, "Computer-Assisted Music Instruction: A Look at 
the Potenti&l," A Laboratory Report, September 1968, Oakland 
University, School of Music, Rochester,' Michigan 48063. ; , 

Thrke Walter, Final Report, "An Experimental Stuiiyrpf the^ Valldi-ty 
and Effectiveness of an Automated Rhythm Training-Program, ERIC 
Document Reproduction Service, 4936 Fairmont Avenue, Bethesda, 
Maryland 20014, 'EF/O 32-7- 



r 
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\1. Mathematics and Physical Scien,ces 
' a* General 



, * ♦ 



1. Organizations 4 



American Asg^ciatXon_5^:lSk^vancement of Science 

1515 Massachusetts '^^^t^z^^^i^ 

Washington, D. C. l^smy^ ' 

Science , a weekly magazine which occasionally carries articles 
on computer use in^education. • ' 

National Science Teachers Association 
1201 16th Street, N, W. r' 
Washington, D. C. .20036 \^-^'. . \ 
Robert "^B. Carleton, SEx^cutive Secretary 



Science TeacheifiJournal 



"CoB^iuters— Iheoly ind-Uses^\ prepared by IJSTA for secondary school 
classes,^ this tmit haa-both j Student *s Manual and a Teacher's Guide. 
The Manual gives jbasic infoiSation on computers, how they operate,' 
and theitr place and t^es in today *s worldl Ihe guide includes source 
and reference materials, 1964. Individual titles $1*00, 



Mathematics ' 
1, fdrgauizations 

. NatioiMkl Council of iT^cheis o£ Mathematics (NCTM) 
/ 1201 16th Street, k| W» 



Washington, D, |a036 



\ 



I 



"Gomputer Assisted Instruction and the .Teaching of Mathematics," 
Report of a n4tional cgkference, 1969, 152 pp*, $2.00*' 



T7 

"Computer Facililties £ot Mathematics Instruction," Inforination 
on educational /uses of (^mputers at the secondary school level, 
1967, 47 ppl, /$.90. \ ' , 

"ComBUter /Oriented MatheAatics," Basic principles- of automated 
computation /as they relat|t to mathematics, illustrated, 1963, 



/ 



'204 pp. 



r.5o. 



/ 



-HI 



/ 



IntrdSu^ to att Algorithmic Language pASIC)," 1968, 
4%^#/./$1.40. 



/ 



'C<M6puter Applications for^Mathematics Education - Selected ^ 
BiMiography," January 1969, 7 pp*, no charge* 



thfe 



Journal of Research in Mathfematics Education , quarterly 



/ / 
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" The Arithmetic Teacher . 

Tlie Mathematics Teacher ' / 

Both .are published 8 times a year with occasional articles on 
the use of- compjiiters in teaching and learning. The Mathematics 
Teacher contains a regular column on "Computer-oriented ' 
Mati>einaticsw ''r ^ - \ 

, * ' V Y ^ \ ^ ' ^ 

Mathematics Associja^ion of America (MAA) 

1255 Connecticut Avenue, N.W. 

Washington D,C. 20036^ 

Committee' on fihe Undergraduate Pifogr 
Dr.- Herbert Ginsenberfe, Chairman 

CUFM Newsl^ 
CUPM Centra 
' P* 0* Box 1 
* BerkelTey, Ca 



Mathematics (CUPM) 



Editors: 

Committee on Edu 
P* 0. Box 2310 

San Francisco, Caiifomla 94126 



Center for Research in College Instruction of Silence 

* and Mathematics^ (Crac^^ 
Dr. Guenter Schwarz, Direbtof 
2X2 Diffenbaugh \ 
Flor^ida State University, i ' 
Tallahassee, Florida 32306\ 



\ 
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Computer-related course ir| calcultis 

\ ft 
^ \ 

ACM Special Intere^ Groups! on: ^ 

Nunerical Mathematics I (SIGNUM) ^ Newsletter b i- 
Hathematical Pcogr a rmni ln g (SIGMAP) = Newsletter I \ 
Syabolie an^ Algebraid Manipulation (SIGSAM) \- BUll6tin 

^ ' f ■ ' 

c/o AQi Natiohal HeadqTiarter 
1133 Avenue o| Che Americas 
New York,. N., %, \003e 

. -1 
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2. Other Publicattons 

Pest., D,, ^'Tlie Use of Computer^ in Secondary School Mathematics*" 
1970, 251 pp., $4,95. Avail^hle from Entelek, 42 Pleasant Street, 
Newburyport, Massachusetts 01950 

Computing Concepts in Mathematics (CCMX , 
Educational Plahning . - 

Science Research .Associates, Inc, 
2^59 ^'st Erie Street 
Chicago^Illinois 60611 

This two semester course is designed to give secondary and 
college students insight Into computing and the use of the 
computer afs a tool in the study of ma^thematics . 

* . _ CAM? (Computer Assisted Math Prpgram) 
David Johnson 

University of Minnesota y 
^ Minneapolis, Minnesota. 

c. Computer Science 
1 . Organizations 

ACM Special Interest Groups "onx 

Computer ScjLence Educatioii . (SIGCSE) - Bulletin 
Computer Graphics ^ (SIGGIU^H -/Newsletter COMPUTER GRAPHICS 
Real-Time Processing (SIGREAL) - Newsletter: 
Computer Personnel Resources (SIGCPR) - Newsletter 
University Computing Centers (SIGUCC). - Newsletter \ 

Association or Educational Data Systems (AEDS) 
.1210^^SixteenIh Street, N. W. 
W^hingtoif D.C. 20036 " ' 

AEDS Monitor - monthly newsletter 
Journal of AEDS - quarterly 

Special attention to secondary school programs 

d. Physics ^ ^ * x ;^ . 
!• Organizatfons / 



Comjnissi^ on College Physics (CCP) 
John M* Fowler, Director 
(Departn^nt pf Physics and Astronomy) 
University oi Maryland. 
4321 Hartwick Road . 
Coliege Park, Maryland 20470 ; 



I App A Sources 



The Computer in Physics Instruction , proceedings. of a 
Conferencl, November 4-6, 1965, at the^niversity of 
California, Irvine. Previously available from Comission on 
College Physics; to be replaced by the proceedings of the 
1970 conference, • . - J- « 

Conference on "Computers in Undergraduate^clence Edudation," 
held at the Illinois Institute o'f Technology, Chicago, 
Augtist 17-21, 1970, sponsored by. CCP and ITT," Preliminary 
proceedings were available at the conference and the final 
proceedings are expected early in 1971. 

Alfred B. Bbrk, Artnur Luehrmann, and John W. Robson, 
(Ronald Blum; edO> Introductory Computer-Based* Mechanics: ^ A 
One Week Sample Course ,, November 1968. , 

Ronald Blum (ed.)> Computer Baried Physics; An Anthology , 

September 19^9 

^ t' * • 

Ronald Blum, and Alfred Bork, "The Computer in the Physics 
CurriculiOT, American Journal of iPhysics , July 1970* 



Center^ for Research In College Instruction of Science and Mathematics 

(CRICISAM) , ' ' 

Guenter Schwairz, Director ^ ^ ^ 

212 Diffenbaugh \ - . ^ 

Florida State' University , \ . 

Tallahassee, Florida 32306' 



"Computers in Physics 'Instruction," Physibs Today 
September* 1969. It will be updated in a jforthcoming Unesco 
publication entitled "New Trends in Physics Teaching." ^ 

American^ Institute , of Physics ^ ' . * 

335 East 45th Street 
New York, N.> Y. 10017 

, American journal of Physics - 12 issues per year - it contains 
^ k section for description of instructional uses pf the computer, 
includlpg provision for obtaining copy of programs in computer- 
readable form. (Further details are given in Volume II Ajppendix C 
on recommendations for professional societies and publications.) 
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e* Chemistry ' 

1* Organization . . ^ ' " , • 

- ' American Chemical Society * . ' 

Division of Chemical Education * / - 

• . ■* 

Journal of Chemical Education ' ^ ^ 

Chemical Education Publishing Company, 
• 20th and Northampton Streets 

Easton, Pennsylvania 18042^^" *• ^ 
Spring 1970 issue includes articles on computers in .Education 

' Vational Academy of S*ctences - National Research Council 
division of Chemistry and Chemical Technology^ 
2101 Constitution Avenue, N.Vf. . \ - ^ ^ 
'S Washington, D.C. ^ 

« 

^ " 4* Committee on Computers in Chemistry ^ 
Dr.'' Peter G* Lykos,* Chairman . 
^ Illinois' Institute of Technology * * - , 

Chicago^ Illinois 60616 ' ^ » \ ^ 

I ' ^ * . . ' ^ 

2- Other Publications - / 

Modern Teaching Aid§ for College" Chemistry (Serial Publication 1&) 
Alvisory Council on College Chenilstry' 
Stanford University 
Stanford, California 94305 

f. Biology 

1. Publication ' 

Proceedings of ^the Eighth Annu^al Symposium on Blomathematics and 
- Computer Science in the.Lif e-Sciences;- iHouston, Texas, March 23,24, 
1970. There was one-session* devoted only to CAT in the Biomedical 
Sciences* • * . ' 

g. Geology \ " 

1. Organizations ' \ 

American Geological Institute 
. Council on Education in the Geological Sciences^ 
! 2201 M Street, N. W. 

Washington, D. C. 20037 " 
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Osbforiie,''^R, H,, "Undergraduate Instruction in Geomathematics," 
To/U-n.l of Geolos ^ical Education , Vol, XVII, No,^ 4, October 1969- 
Sliort Review reprint available., ' • 

Fox W. T..,' "Comput^r-ori'entad Xaboratory .Exercises for Geology 
^n^'n^o..nnffr;^fihv. "^ Journal of Geologi cal. Education, Vol. XVII 
No. Octobjfcr 1969. Short Revlwr reprint «yall»ibl«. 

. '\ ■ ., -■ ' - : 

, ^American Association of Petrol,eu« Geologists 

Box 979 y 

Tulsa, Oklahoma — -94101 . ' , 

\ ^ ■ ■ ■■ >■ ■ 

2. Other Publications 

Kansas Computer Center Cont;riljution Series Publications 
Computer Center • 
, " University of Kansas ' . , 

Lawrence, Kansas 66044 

Published also in cooperation with the ^tdte Geological Survey 



r 
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Pehavioral and 'Spcial Sciences 



/ 

uaneral 



Orga. i i« 

ACM Soecial Interest Committee on Computers and- Society (SICCAS) 
fm special interest Group on. Social, and Behavioral Science Comp^^ 
c/o ACM National Headquarters ^ , ' 

1133 Avenue of the Americas 
New York, N. Y. 10036 . . i 



- SICCAS Nfewgle€ter - quarterly 
^ ''SIGSOC .^iew sletter - quarterly 

7 — TT " p 

2. Other Publi^fations \ 

■ Gr"een, B^t F. , Digital Computers in Research . Holt, Rinehart and 
' Winston, New York, 1963. Part III summarizes applications In 
behavioral sciences. 

Stone, PJWlip J., The General Inquirer . L.I. T. Press, Cambridge, 
Massachusetts, 1966, 65t pR. . Discussion of procedures for and 
appli'catidns of content analysis in psychology, sociology, political 
science, anthropology, history and literature. 

Meyers' Edmund D.' JrL , "IMPRESS and Undergraduate Edncatlon in the 
Social Sciences, " in T>^nr..mnf, a of a Conference on Compu _te£8ln 
" the Undergraduate Curricula , University of Iowa, Iowa City, 1970. 

Meyers,' Edmund D. Jr.,' "Interactive Systems and Social Science 
Research and In^t ruction," Social Scienc^ Information . June. 1970. 



b. Psychology " . 

1. Organizatio|i ^ ' 

r 

Mierican Psychological Association 
1200 Seventeenth Street, N. W* 
MashingtcJn, C, 20036 / 

- American Psychologist , a mcinthly publication 

. ^Tfie Journal of Educational Psychology , bi-monthly publication. 

V ' Educational Psychologist , newsletter of Division 15 

(Educational Psychology) 
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c. Sociology 

1. Publication , ' . 

Cline, Hugh F. Whd Edmund D. Meyers, Jr., "Problem Solving Computer 
Systems for Instruction in Sociology," in The American Sociologist 
(in press) , 

d. Political Science ." ' ' 

1. Organization , " 

■* , ' 
The American Political Science Association . 
' , 1527 New Hampshire Avenue, N» W, ^ . . 

Washington, 20036 ^ • 

Commiftees on Pre-Collegiate Education and Undergraduate Instruction 

' A Committee on Scientific Information Exchange may undertake 

activity in the area of .instructional use of the computer, / 

e7 Geography ^ ^ _ 

1. Organization. . • - -^^^ 

Commission on College "Geography . ^ 

Dr, John Lounsbury, Dire^ctor 
Department of Geography 
Arizona St^^ University 

Tempe, Atizona 85281 ^ ^..^----^ 

s 

"Computer-Assisted Instruction in Geography," Technical Paper No. 2 

Panel, on Computer' Assisted Instruction 
Dr. Kennard W* Rumage, Chairman 

Department of Geography - ^ ^ 

State University College at Brockport 
I ' Brockport, New York 14201 



■b 



f . History/ 



1* Organization 

, ' Mathematics in the Slocial Sciences 

Subcommittee on Itophematics and Statistical Methods in History 
Dr* Robert W.^HPcJfel, Chaimwn \ 
Department of Economics ' f 

University of Chicago ' ^ 

Chicago, Illinois 60$37 
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> Historical Methods Newsletter ' i 
Jonathan Levine., Ed±tor 

Departmentof xHistoiry ^ , ? ' 

University of Pittsburgh 
Pittsburgh* Pennsylvania 15213 

A quartj^4y newsletter publishing short articles, research 
notes, ^^eview essays and aimouncements. The editorial office 
maintains an active, file of reports of research in progress 
and can respond t^o queries for infprmation about particular 
techniques or data. 
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4* Professions 

a. Architecture 

1* Organizations 



American Institute of -&Vchitects 
Frank L, Codella, Admini'stratctr 
Department of Professional Services 
The Octagon 

1735 New^ork Avenue, N. W. ' 
Washingt;on, D. C. 20006 • 

A non-profit corporation sponsored by.AIA is 
Production Systems for Architects and Engineers, Inc.- 
343 South Dearborn Street 
Chicago, Illinois * 6060A 

ACM Special Interest Group in Urban Data Systems, Planning, 

Architecture and Civil Engineering (SIGSPAC) 
c/o ACM Kational Headquarters : 
1133 Avenue of the Americas ^~ - 
New York, Y. 10036 



SIGSPAC Bulletin - :bi-monthly 



b. Business 



\ 




1, Organizations 



Project on Computers in Management Education ^ 
Michael S. * Scott Morton, Director ' 
Alfred P. Sloan School of Management 
Massachusetts Institute of Technology ^ ^ — 
50 Memorial Drive . ' . ^ 

^^Cam&ridge, Massachusetts 02139 

ACM CurjTiculum Cfommittee on Computer Mucation for Management 
Prof esjor .Daniel Teichtoew, Chairman ^ 

Department of ^Industrial Engineering . \ 
College of Engineering' 
» University of Michigan 
Ann Artor, Michigan 48104 ^ 



Report in preparation; ^y 1969 interim report available. 
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ACM Special Interest Group on Business Data Processing (SIGBDP) 
c/o ACM National Headq :arters 

, 1133 Avenue of ^the Americas ' { 
New Yorl^, N.^ Y. 10036 
# • * 

Administrative Data Processing .Group (lAG) .„.tftp^ 
International Federation for Information Processing' (IFIP) 
6 Stadhouderskade 
Aitisterdam 13," The .Netherlands . 

**' 

lAG Journal: , quarterly . 



\ 



i I 



Education \ 

1, Organizations / ' 

National Association of Secondary School Principals (NASSP) 
Committee on Computers in Education 
-. 1201 Sixteenth Street, N. W. " ^ 

Washington, D. C 20036 

Series of executive seminars for educational admiltistratars on 
computer in education 



the 



National EducatioH Association 
•1201 Sixteenth Street, N. W. 
Wa'Bhington, D. C. 20036 




NEA Han dbook , published annually, available from the 
Publication-Sales Jection at $2.00 a single copy. 

.ierican Educational Research Association (/^RA) 
m6 Sixteench Streetv*;N,W. ■ 

WalyJii^Ston,' D.C. 20036 ^ ^ ^ 

Sepecial Int-rest Group on Computer Aids to Learning 
R^rt Seida.^Ghainnan . 
HumRRO. Project IMPACT 
sod N. Washington Street 
Alexandria, Virginia 



J 
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d . Engineering 

. 1 • Organizations 



American Society jof Engineering Educatioi;i " - / * 

Suite 40e ' _ 

One^Dupont Circle 

Washington, ^. C. 20036 • . ' ^ 

\ ' - ' ' % , * * 

Committed on Computers in /Engineering Education *« ' 

Committee! on Educational Research and- Methods * 

Committee |on Information Systems ^ 

i' 

Engineering Education , a monthly publication, September 
.V through Jiine, $16,00. ' ^ ' . ^ 

National Academy of .Engineering - . . 
Commission, on Education ^ 
2101 Constitution Avenue, N* W. 
•Washington, D. C.^ 20037 



V 



Committee on Instructional Technology 

'^Educational Technology in Higher Education: The Promises and * 
-Limitations of ITV- and CAI," Report, of ttie Committee on 
Instructional Technology of the Commission of Education -of 
the N'atidnal Academy of Engineering, John R* Whinner y, Chairman, 
• ^ WasMngton, D. September 1969. • ' 

%)ramit%e on Computer Sclencle In Electrical Engineering (COSINE) 



e« Journ alism 

V ■ =^ 

S 

1, ' Organization 
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Assooiationf for Education in Journalism 
Ralph OJ iNafziger', Executive Secretary 
425 Henry Hair ^ ' . - . " ' 
University of >?isconsln ^ " 
Madison, Wisconsin ^53706 ' 

Diviaion on fffeory and MethodologV 
Lioriel G* Barrow Jr . ,*^hairman^ '1 
Research Department • ^ 

Faote, Gone-&,terdlng 
BOX) Park Avenue^ ' * - 

N^ York',, N. 10017 . t 

:. ir / . 

H - 
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f. 



Law , 

"^1. Organization ^ " 

The American Association of Law Schools 
■It^ll New Hampshire Street,, N. W. ^ 
Washington, D. C. 20036 

- ' Committee on Teaching Methods 
Arthur R,.MiHer, Chairman 
335 Hutchins Hall 
University'^ of' Michigan 
Ann Arbor, Michigan 48104 

Library Science 

1. Organization 

American Library Association 

Inforraaiion Science and Automati£on Division 

50 Eas<f Huron Street 

Chicago, Illinois 60611 

Committee on Library Education 
Committee on Inter-Divisional Education 



V Jc urrial of Library Automation - quarterly, professionals 
\d€ui;iral containing infotmation iDn original work In computer 
^'Spb^lications for data prooBwslng in -libraries. 

- Technical Communi^atiens monthly newsletter 

^onoV^pfi\ ^^Library Automation - A State o^the Art" 

MedicTLne and Dentistry * ♦ 




!• Organizations 



Continuing Educ^don and Training Branch 
Diyi#itn of .RegidW Medical Pp^ifams 
National Inst i^^ 

.Department of Welfare 
Bethi^sdav Maryland 20014 

Various reglonai programs, include projects on the instructional 
use ^i' computers, / * 
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Lister Hill National Center for Bioraedical. Communications 
8600 Rockvflle Pike 

Bethesda, Maryaand 2001 A : ! 

'•Davis, Rilth M., "Technology in Suppor^t of Medical Education," 
Lister Hill National Center, ^'ebruary 1969. 

Clearinghouse for Programmed Materials in Medical Education and 

Health Care „ . ^ 

University of Rochester School of Medicine and Dentistry 

Rochester," New York U620 = - • 

'"I^iTspecial intfarest Group on Biomedi^'lr^nformatioi Proce/si^f, (SIGBIO) 
G. Otto Bamett,\chairmaji " 
c/o ACM National Headquarters ^ ^ 
1133 Avenue of the Americas 
New York; N. Y. 10036 . . 



STgVo Newsletter - published eviry two months 



professional Education Branch ' 
Division' of Dejital Health > 
National Inst-itutes of,Uealth 
Department of ftealtli, -Education and Welfare 
Bethesda, Maryland 200U . 



Proceeairigs jf th^ conference "Instructional TeWWology in 
-Deirelstry " a report -bf the Conference on Computer , 
Applications iq cental Education, held in San^Francisco, 
October 2f5-31, ^969. Avairable., from the. Dental Healtn 
Center, .lAth Avenue and Lake Street, San Francisco, , 
California 94118. 



eWio] 




beSBbcJ' 19.70 



Project CLUE 



■4 



i 



I App A Sources 



■■I---. 



til 



2. Other Publications 

Computer Programs in. Blomedl'cine 
Nortli Holland Publishing Company . 
. p. 0. Box 3489 / . . " .. 

Amsterdam, The Netherlands / (published quarterly) 

■ . . I .- _ _ » 

Internationai Journal of skomed ical Computing 
J. Rose,' Editor ' 

Blackburn College of Technolog.y. and Design * 
> Blackburn, England i-ipublishedj quarterly) 

■Proceedings of "Conference on the Use of Computers in Medical ' ■ 
■ Education,- April' 3, H= ^nd 5. 1968, Oklahoma City . Oklahoma. 
Available from the University of Oklahoma. Medical Center, 
800"n. E. 13th Streef, Oklahoma City, Oklahoma 73104. 

Proceedings of an ONR-supported ^/:onf erence, "Computer Assisted 
* Instruction in the Health Professions," he^d in Cambridge. Mass. 

in Febr,uary 1968. ^E^ited by lavrence M. Stblurow,. Theoaore Peterson, 
' Anne CuAnin^ham, Entelek, NewbTUryport , Massachusetts. ?• ^ ^ 



\ 



1.' 




Social- Wotlt ' 

1. Organizatiqn 

Council on^ycial Work Educatioa' 
345 East h/th StrejJ , _ • 

New York /N. Y. i0017 ^ ; . 

A catalog ^f audio visual and other technological aids for 
■ -teaSSg? isl w?ald expect inEorm^tion about computer uses- 
to be in61u|ed as it becomes- ^vailable. ^ 

Urban Planning 1 . ' 

1^* Organization , . * 

-ACM Special Interest Group on Urban Data Systems, Planning,, 
" Architiectute and Civil Engineering . . / 

c/o ACM National "Headquarters , ' 

1133 Avenue of tHe Americas 
. New York, N. Y. 10036 



STGSPAC Bulletin - bi-tnotithly 
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V&lMm i - APPENDIX B 



INTERPRETWE DESCRIPTION OP REPRESENTATIVE iiPROJECTj 



Summaries of a nua4>«t of fproject^ are provided in this /append: 
reader who' is nev tfo the [field ^ indication of the diversitx 
research and appUfcatione. Directors of a sample of projects 
present in two at three pages th^ overall goals, procedures ai 
current effort^ Some were unable to respond on the clme sch< 
preparation of this doc^ent, ai^ staff of Project C^UE adap 
statemapt to serve the purpose. i\ 



to give a 
Ind, depth of 
refe invited to 
jfd ! successes of 
bdtkle for 
id 6X1 escisting ' 

I ^ 



The reader ' should gain an idea <^f what he\would ffnd If he /were; to* look 
fux^et into the technical repo:p.ts and dea^rlptiw material for each project 
or to visit tHe site. Hopefull|^ these briitf. at^eacnts w;tll encourage the 
reader to obtain further infon|stion on- projects which particularly interest 
him* ^ ' / 

% ^ - * *■ ' / ^ / 

Only ^ few repii&sentative projects are incltaed in this appendix', and eac^j 
fits inW aore categories th^^^ it 1« listed i A list of all 

person^ and projects contacted during the^study is ^iven in AJ^pendix B of 
Volume II. . / 



OS. ^ 

El 



CONTENTS 



ementary and Secondary Schools ^ 

McComb Public Schools, Misslss^^ ' , ' 

Division. bf Instru^tifinal; Systems'^ School District of Philadelphia 
PrQjecti LOCAL, %stport^3ublic ScHoolsV-Massachusetts * ' 



Colleges and Universities* ; . , . * ^ ' 

Center ft^^search on learning and^T^aciing, University of Michigan 
' Kie^it Con^uiation Center , Dartmouth College 

Regional Service tenters and eonsortiuas' ^ 
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University Training Programs ^ 

CAI Laboratory, The Florida State University, Tallahassee 
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IBM. Field Engineering Division, Poughkeepsie, New York 
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Military Training , ' • . 

^ * ' ° 

'*(infomation nqt^provlded in time fpr this printing) 
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CAI Laboratory, Bari University, Italy ' | 

CAI Laboratory, The University of Texas, Austin ,1 
'Learning Research and Development Center, University of Pittsburg^ 
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McComb Public SchooJLs , ^ 

McComb, Mississippi , 

* f 

The McComb Con^uter Assisted Instruction Project ha?^as its initial goal to. 
determine if computer- assisted instruction is feasible -for use in a typical 
school setting* Documented evidence indicates that the system developed by 
Patrick Suppes for drill-^and-practice in elementary mathematics is viable" 
educationally. Our effort, however, was primarily intended to determine 
whether this program is practical. . - 

Our school! district is a xather typical ^.Missi$:3ippi municipal separate school 
district,, . altl^ough above average- in per^gupil expenditure. Our re^^rces 
were rather modesfei|x a number of areas 1.%^^^^ per pupil, staff, physical- 

facilities, and res^ar^^s 'to support the "e^^^^ program. We saw in 

computer-assisted instruction an opportunity ;to upgrade considerably the 
instructional program of our school district if t we could afford it; our 
teachers could learn to use it effectively; administrative problems were of no 
real consequence? it did. not create too m^hy^ technical problems; and if it 
produced the desired educational gains in our student body. 

After two and- one-half years of using the Suppes' drill-and-practice program, 
we can. say* witKbut equivocation that this program meets [all of the criteria 
outlined above with the exception of cost. Quite frankly, we now believe that 
the cost factor is not an ihsum^ountable hurdle. Drill--and-pracfice CAI systems 
do offer a relatively inexpensive opportunity to" provide individualized drill 
for skill subjects. At: the moment, excellent programs are available in 
-mathematics and English. Admittedly, these prqgr^Qas__are^cf!^algned[-only as a ^ 
supplement t^^tclassroom instruction; however, they do provme the potential for 
strengthening Vital skill areas for elementary pupils by pirtial .replacement of 
direct teacher^ supervision* ^ ^ ^ 
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Our research^ data indicate that drill-and-practice CAI has particular relevance 
to current' needs in provi^ling instruction for the disadvantaged child. Our 
'Experience shows that gaps in achievement between populations of the disadvantaged 
and ^11 other children can be narrowed by the use of computer assisted instruction. 
Evidence may yet be ileveioped to indicate that, from th€( d'tandpolnt of coat 
effectiveness., computer-assisted instruction should be provided only for those 
groups of pupils who profit subsffantially from the program. We believe that the ^ 
brighter children, particularly -those who are economically advantaged, do not 
profit sufficiently from computer-assisted Instruction to merit the cost of this . 
"""-"Ins^tructional program. Some challenge our belief in this matter, but we hold 
to Our position until further research disproves our.^^dontentio<u 

From technical i\ ? cost standpoints, a hardware 'sj^item should be. composed of 
small digiWl compufers which provide daily dril^ to^pupils on the* simple 
terminal si^dh* as the Teletype ASR-33, terminal • Thi%elults of daily drill 
performance in this satellite system are easil-^^'^batch processed" on*a larger 
computer and drills for subsequent days* lemons ^"prodifced for* return to the 
satellite sys,tem. In school systems which have available time on the data 
processing computer for Administrative services, the small computers . and terminals 
constitute the main hardware cost. Where possible, the teletype terminal should 
be hard-wired to tfie digital computer to avoid major Communication costs. 

properly utilized, computer-assisted instruction can actually replace some : 
"^^^ssrooin teacher time* The combination of computer-assisted instruc^pn with 
an excellent cllssroom teacher is only slightly more expens^fve-s over the long 
run, than straigtit classroom teacher instructional cost.. Figures should be 
, available soon to substantiate the Contention that computer-assisted instruction, 
which replaces a portion of .the classroom teacher*s time will be 'relatively 
inexpensive even when Including the cost , of computer hardware in total^uSgetary 
calculations. . ' " ^ 
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Computer-assisted instruction utilising drill-and-^practice represents a v^ry 
limited application of the wide range of instructional techniques which can be 
instituted using sophisticated computer hardware* However, .this approach 
using small satellite computers to administer daily drills is a significant 
technique whicti^can_meet-^h^e test of practicality in an operating school 
pMgram^ tod ay . 



-I 



r 



Mr. Julian Pritice 
.Superintendent of Schools 
McComb^ Fublic Schools 
McComb,^ Mississippi 
January 10, 1970 



Reference 



Prince, J. B. "Computer Assisted instruction in the Eleni^ntary School," 
AEDS- Monitor > January 1969, pp.. 1-3. 
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Division of Instructional Systems 

The School District of Philadelphia .» 

The School District of Philadelphia has beea a pioneer in the use of computers 
in the instructional process. Recognizing the critical function the computer 
plays in education, the School District of Philadelphia is involved in the 
following areas: 

r 

1. ^_ Developing and implementing courses^in computers so that students 
^ ^ can apply them/;to various disciplitles and be aware gf «their 

cultural significance. ^ ^ 

2. Developing curricula designed to acquaint students with career 
opportunities in data processing and to help them develop tHe 
skills necessary to enter this vocational field, * ; 

3. Using computers to facilitate and individualize instructional 

0 Processes • . 

4. Training teachers and other staff members of tKe School District 
jin the use of computers so that they may apply them to the " 

' improvement of instaruction, 

5. Developing/ Implementing, and evaluating new and promising 
techniqu&s erf teaching such as those involved in "Gaming 
Simulation." ' * • 

6. Exploring innovational aspects of educational technology and 
developing innovational techniques. 

The programs described in this report represent the main thrust of the Division 
of Instructional Systems at this time. Other areas are still to be explored. 

At the Senior High School level, a variety of courses, equipment, and programs 
serve the object of giving students experience with computer problem solving. 



Through actual experience with equipment, students develop familiarity with 
cptoputers and an understanding of what computers can do, how they work, how 
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they are programmed, and how they are utilized in business, science, and 
industry* As pupils learn about career opportunities in the computer field, 
they develop an awareness of thi' effect of the computer revolution on tech- 
nology and-its cultural implications upon our society. 

As they'^become proficient in computer languages, ^stu^ehts learn *tofuse 
computers to solve, problems in subjects such as mathematics, chemistry, and 
physics. They. learn about problems which cannot be solved without the aid 
of a computer and/they study the mathematics needed in the formulation of 
computer oriented problems, 

'The computer concepts course for junior high school students was introduced 
as a pilot project in five schools in September 1967. The success of that 
project, has led to the expansion of the program so that by February 1970 
every junior high school offered a coursie in computers to its students. 

Junior high school students ,work at a teletypewriter terminal connected by 
telephone to a large computer. Students utilize the terminal to execute 
programs which they have written as part 'of the computer concepts course ♦ 
The course is offered as a^wo-period minor <»to students in the ninth grade. 



Cfver 2000 elementary school students have been helped to understand that a 
computer is not as mysterious as they might have thought. An exciy.ng 
approach to learning is computerized games. Fifth grade students are 
participating in a program which utilizes a special audio-visual computer 
terminal to present the Sumerian game — an economics-based simulation 
"which places the|studerit in the role of ruler of the^ ancient kingdom of 
Sumer. The participant evaluates reports from his council regarding^. the 
Status -'of .his kingdom and based on this iiiakes decisions which affect the 
economy' and well being of his people. The computer evaluates the student *s 
decisions and adjusts its figures on the economic status of the kingdom 

accordingly. - v 

\ * - - 
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Curriculum Development ' ' " 4** - 

Computerized games provUe opportunities for decision making and appro'aches 
not easily eicperienced in .the classrooiu. Games can promote discovery by ^ • 
simulating events, decision strategies and problems. 

> : . X 

Since November^ 19'67, students have been ^receiving individual instruction 
in reading and biology through a i-)mputer. -A Title I grant to^e School 
District of Philadelphia Initiated the development of a large scale computer- 
assisted instruction program. The system consists of a central computer and 
five clusters of computers with eight terminals in each of fiv^ schools. The 
clusters are connected to ^the centra^, computer, located at the^ Computer 
^Center, by_ telephone lines. 

The cufricuitim has been deyelpjped: by School District of Philadelphia per- 
sonnel. VA 10th grad^^ bt^^ includes instruction in biology, its 
^histOT3>^%cience vs» superstition, scientific mc^thod, cell and cell theory, 
characterVsti#- 6f "%,fe,^ a^^^ . In reading the emp^is is on 
raising: the: ;re^^^^ such'as recognising main'id^/as, follow- - 
f^^4^;ectiq^^^ As a student encourfters 
^,r^^J[3?S&^5^ easier, presentation of material, 
p^^ti^^t to this material. The 
^?^tudeiiti^i^ directed, Intc^ of instruction sluited to his needs. 



i 



The Jchool District of TO cooperation with the Regional Ls^b- 

oratory, Research for Better Schools, is developing individually prescribed 
elementary, mathematics material consisting of placement tests, pre-tests, 
^o8$-tests, and instructionai^material for computer assisted instruction, 
^^^fes^terials^^r^deveio^ed li%t of carefully sequenced 

^SifucMonal ob^ee^^^ The objectives follow a 

cSfitln^fc thrdug^ such as place value, divi- 

^siph>Iige6inetTy^, etc . " 



^ ^^i^^v;^ecember 1970r^ 
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The CAI program Is providing for^ continuous monitoring of the student's per- 
formance in terms of subject patter competefice, differential mastery, and > 
requirements for new learning. The burden- of scoring and progress analj^sis/ 
is carried by the computer. ^ Branching of the student according to his 
individual needs is automatic. , " * " t | 

The computer and the automated pro^cesses associated with it have created 
dramatic changes ±11 the employment situation. The Philadelphia School dis- 
trict was one of the first to recognize ' this and a^ early as* 1961 had 
instituted courses in data processing. Since that time the program has ex- 
panded throughout the entire ^hool system. 

Facilities - ^ ^ ^ 

The Instructional Computer Center serves as a focal point for man^ programs 
and activities. large Philco 102 Computer housed here is the^^"Sriver" 
for smaller systems located. in four secondary schools which provide Computer 
-^sisted Instruction material for courses in biology and reading as part of 
their regular roster, ^ In addition ^to^ servicing this i)urpose, the central/rcom 
puter provides computerize^ curriculSim for the terminals in ^the computer 
" center ♦ Curriculum material for this system is prepared by teams of 
writers,^ programmers, coders, and techni'-al sta^ housed at* the Center.' 

The Center also services as a demonstration and evaluation location ^f or <^ 
automated education ^uipment. Manufacturers are encouraged , to leav^ their ' 
equipment, where it is evalixated by the staff and teachers and ^administrators. 

The Center ^serves as the central agency in a time-sharing arrangements which ^ 
provides computer time to all senior high schools and most o£^ the junior 
high schools, ^ Students irf" the schools < communicate .with an IBM 1130 co^ 
at the center via a teletypewriter. Utilizing thig arrangement, students . 
have for 'their use in solving mathematics and science programs a cbmputer 
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wl\ich would be too expensive to supply to each of the schools. ,The School 
District of Philadelphia ic the first school district to operate its own 
time-sharing system. 

The Center serv^^s the school 'district and the community by providing faci- 
lities for after -school prpgrams, staff development, adult education programs, 
etc. Home and school associations, community groups, neighborhood clubs, etc..^ 
are invited to attend lectures and courses explaining how computers work. 

At present, studios are being made to make CAI mor*^ universally available 
at greatly reduced costs. Plans are underway to develop new computer-based 
games; procedures which would involve many mere teachers and students are 
utider development. 



Prepared by the Project CLUE staff from "Computers in the Instructional 
Program," from the 1968-69 Annual Report of the Division of Instructional 
Systems, Dr. Sylvia Charp, Director 

Reference • 

gharp, Sylvia and John Wooison, ''Using a Computer to Teach," AEDS Monitor , 
vol. 7,' January 1969,. ppr 6-7. * 
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Project LOCAL - * ^ 

44 School Street 

Westwoodj^^ssachusetts 02090 " * * 

Project LOCAL, ^ the Laboratory Program for Computer-Assisted Learning is a 
five-town cooperativ^e endeavor set up to improve instruction by using the^ 
computer as a teaching aid. LOOAL, which for three years was a Title III 
ESEA project, is now chartered in Massachusetts as a tax-exempt educational 
corporation* Its membership includes the towns of Lexington, Na^ck, 
Needham, Wellesley, and Westwood. 

local's five PDP-8 computers, which can accomodate over 3,500 students, 
prpvides services to over fifteen school systems in the Boston Metropolitan 
area. LOCAL has trained over 200 teachers from this area in the techniques 
of teaching via computerized problem-solving. 

-The over-afl goals of LOCAL aire a^ follows: 

1. To improve the achievement of mathematics and science curriculum 
objectives, especllally in the areas of achievement, problem-solving 
skills, and attitude. - ' ^ 

2, To te^ch to the widest possible segment of the/pupil population ♦a 
basic understanding of the computer in its role ars an important 
element of modern society. - ^ __ ' 

In order to achieve its-objectives, LOCAL conducts the following programs:,, 

1. Using the computer as a teaching aid in the regular math and 
science curricula to accomplish ends such as motivation, reinforcing: 
concept understanding (problem-solving and drill) concept demonstra-*' 
tion. creation of discovery learning situations, (simulation of systems 
to "be studied), and increasing efficiency (automation of^ required 
operations). 
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2. Integrating Instruction about the spcia^ implications of the 
computer into the regular social studies curriculum*. 

3* Organizing^-'and sponsoring computer clubs to provide an outlet 
for students with spedial i^erests and to teach computer concepts 
not normally taught^^n a math\or science class* 

4. Setting up and maintaining a par ticipatingj. membership program 
to provide computer services to other school ^sterns. 

5. Conducting pilot programs with appropriate experimental struc- ( 
turlng in order to further evaluate the usefulness of the computer 

as a teaching aid. 

The Project LOCAL staff, consisting of three full--time persons and several 
part-time consultants, carries out a number ct activities required to ^ , 
support the programs outlined abov%^l These activities include, installing 
and maintaining a library of materials^concerning instructional uses of 
computers, (} is semina ting .information via a project newsletter, in-service 
training of the instructional staff, writing Instruction-related computer 
software, writing appllc,at-i^ns for outside* funds, and central purchasing ^ 
of supplies for teletypfewriters. 

Project LOCAL uses several different aCitivitles to realize its goal of 
improved -instruction. However, by far the most commonly used one is the 
simple device of having students solve problems on the computer. This 
method, much like many traditional ones, has students solve exemglarx^^^._ 
.problems following the-explapation of new principles of ones^/Tg^Fig, re- i 
viewed^* However,^ this method is somewhat unique in^that it shifts emphasl^ 
from results (answers) to the pro^cedure' used for problem-solving. 
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A student comes tp understand a principle muc*^ better in the process of ex- 
plaining how to use that principle in problem-solving. The algorithmic 
method employs the computer as the party to whom the student explains the 
steps (program) required for problem solution. In this way, the student 
gains all the benefits of having ^'taught" someone how to use the principle 
being studied and also obtains rapid feedback concerning the accuracy of 

G*"is '^teaching*' i*e,,.his program either runs or does not;* Where a program 
oes not run, the^student accomplishes any ne^:essary re^learning by finding 
and correcting his mistake(s)'; 



The beneficial effect of having students solve problems on the computer is 
very aptly stated by this quotation from signs that' hang the walls of 
math classes in Altoona, Pa*, "If you want .t§"iearn a subject ~ teach it* 
If you really want to learn'a subject 7 program it for a computer*" 

The^^pjimary benefits of computerized problem-solving are improved concept 
understanding, enhanced problem-solving skill, ^d motivation. In addition 
it also impar^ts benefits' 3uch as : allowing for Jja^i^W^^^ '^PP^^^^^^^hes to 
ppoblem-solvihg > enabling teachers to quickly locate weaknesses in student 
c|)mprehension; allowing teachers to assign general-case rather than 
exemplary problems; and preparing" students for later wor^ in either a job 
or at the next vlevel of educatlbn. ' 

Di&lng the 1969-1970 school year, approximately 1,~300' Itudents In LQCAL*s 
^ive member school systems were involved in learning enriched, through the 
ufee^of tHe computer as a problem-solving vehicle. The two programming 
languages used were FOCAL, developed by Digital Equipment Corporation, 
and BASIC. * 

LOQAIs has published several funding applications, an evaluation report and 
several documents useful to the>^classroom teacher. The latter include: 
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Computers in the Classroom by Walter Koetke Resource manual 
for algebra teachers; includes teaching strategies and computer 
programs (13Q pp.) 



ResouJLce >iaterials for Computer-Assisted Science Teaching 
ManualxTor science (primarily chemistry) teachers; Includes 
teaching strategies and computer programs (226 pp.) 



Future' Plans . / 

: ■ ^ ;( < 

LOCAL has applied for outside funding to design, to produce/ and to 
evaluate a computerized clerical support system for individualized instruc-" 
tion' which would be more capable than manual systems/ and far more economical 
than previous computerized systems. This system would be fully exportable 
to other schoofs, yet the presence of computer equipment and trained compufer 
educators already .in our schools would reduce development costs considerably 

^elow what tliey would be otherwise,. 

I ^ - ^ - 

V/ ; 

/Wherever truly individualized instruction is to^'be implemented on a wide- 
scale basis, there is a pressing=,need^ f or a means of coilecting,\processing, 
/ and presenting the data needed by teachers toy/parform functions sjc^^s: 
/ diagnosing learning needs, prescribing learrnihg experiences, acc8^rt£ing" fox 
\ leapiang materials, keeping track of studenf.' progress, analyzing th^ ef f ec- "5 
/ tlv^hess of test items, etc., To dat%, the most successful agents fj/r 
y solving this problem have been: (1) teacher aides and C^)' mediumwand , 
/ - large-scale computer systems. Both of these solutions are relatively ex- 
pensive alternatives^. 

Three of our- school 'systems are in th^ proces$ of implementing wide-scale,^ 
truly individualized programs, and they haVe an urgent need for an 

clerical support for these programsT The other two 



economical means of 
ol 

- / 



cooperating school 3ysteras are taking steps to implement less a^pbitious 
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programs; their needs in this area, although less inmiedlate, will become 
apparent in a /ew years* * - , 

I 

Prelijninary ihvltss^tigation^ f ir.d^s ^o obstacle p*r eventing the use of Project 
1.0CAL's small computers, (which already ser^ln^the classroom \^;ell, in 
the additional capacity of clerks to grad€ tests, to keep records, and tp 

* ' ^ ■ . \ ' * 

write^ reports in support of indlvlduallzeci instruction, ^£ such machines 
are, found to do the job adequately J tfie oVer-all cost of computer-ai^led 
instruction will have been reduced substancidlly arftd the teacher ,wxll 
have available an extremely well-rounded tool: one that helps in 
teaching and also helps with the attendant^bookkeepxng. 



Rqbert N. Haven 
Project^ Director 
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Center for Research on Learning and Teaching , . 

University of Michigan^ Ann Arbor 

The resjearch and development program at the Center for Research on Learning and 
Teaching (CRLT) provides a focus for many University a^ivities concerning the 
utilization of on-Mne computers in teaching. .Instru^fxxonal technology has been 
a maior concern of the Center since it vas.restablif^ed by the Regents of the 
University in 1962 in response to recommendations from several faculty committees. 
Exploration of computer utilization is coordinated with other Center programs 
concerned with programmed instruction, instructional technology, .^afcademic games, 
instructional television,' preparation of college teachers, and the personal 
and social development of stud^^nts. 

Facilities ' ' 

Computer-based, instruction facilities in use at CRLT have been acquired and 
developed in response to the expressed needs of potential users. 'Faculty 
members and. stuWhts identify situations which might beneMt f rom\he use of 
computers or other technology, and describe self- instruction procedures which 
should help solve problems* Technicai assAstants experienced with various ^ 
computer systems and techniques help implement appropriate teaching and learning 
applications suited to the professor's goals and procedures as well as to the 
Ixtdividual needs and interests of students. ^ ^ ^ 

Since early 1968 most instrucj^lonal applications have^been operated from the 
IBM 360/ on campus. The Michigan Terminal-System (itS) provides a powerful 
capability 4or design of instructional applications in a number of areas. Tn^ 
major direction of computer facility development on campus has been to rat % ^jfi 
of one large geiiferal-purpose time-sharing system for Instructional as well \ 
sclentitic computing. As a result^e of the computer for instruction of stw 
has b'een closely associated with use of the computer for research*^ This 
situation has avoided the somewhat artificial separation of instruction and 
research which may follow from the allocation of small and separate computers to 
instructional tasks within a university. 
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' Some research on instructional use of computers does use- separate facilities. 
Using a PDP-9 with a TV display, Williai R. Uttal at the Mental Health Research 
Institute (MllRI) is developing a generative computer-assisted instruction system 
for tutoring students in analytical geometry ^and otfier mathematical topics* The 
Center for Research on Language and Language Behavior developed a Speech Audio 
Instruction System(SAID) for research on training of prosodic characteristics of 

, speech around a single terminal based on a James Greene of tl^e^uman 

Performance Center is assembling a laboratory for research^ par-deters of 
individu^kzed^s^ction, using a smallJLBM-^00 and CRT display devices* 

'MTS/ offers the ;kis^T a wide variety ojKIanguages and powerful command and file 
^ability. The variety of computer' languages available enables an author to 
select the language best suited to each part of his instructional t^sk. Often 
he finds it desirable to obtain the aid of one versed in computer applications^ 
fo" program the materi?al in the most efficient manner for the problem at hand^ ^ 
Recently^ computing techniques and packages have been developed! for incorporating 
new vLearning tasks into curricula in the humanities and social ^ sciences as well 
as enginelfe^ing and science, ^ ^^^^^^^^J,!^^--^ ' 

The most common user--teYTninal devices on campus are the Teletype mode^ls 33 and 
35. Several IBM 274]$^ or Datel selectric typewriter devices offer quieter 
operation and a more" complete set of characters* in addition, §ppli|rations of^" 
graphics display devices in instruction are being developed In^a ^'tmber of 
discipline areas.r ^ — ' ] * 

Demonstrations and Seminars for Paculty ' 

Faculty are invited to try selected examples of comput^-based Tfearnlng exercises 
as "students" at a learning station anr to study the documentation provided by- 
the author that indicates the information stored in the computer. However, it 
is difficult for^an Individual to get^an accurate Impression of th^' potential 
and limieaClons of a computer .instruction system through material In an 
unfamiliar field. A sufficiently advanced sequence of Instruction jin a particular 
field i/robably requires that the "student" have a general background "and spepific 
preparation ±h that field, =^ 
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Therefore, interested faculty members are encouraged to write their own specifica- 
tions for possible programming of an instructional exercise; Center staff implement 
those self-demonstrations, A brief experience as an author provides an interesting 
demons tr a tioiTfoi a potential author, sample materials which might encourage a 
larger development project, and a critical test of the usefulness of the system. 
No previous experience wi^th computers is necessary for success in "self- 
demonstration" of computer use for instruction. 

Often faculty members are interested in transforming some aspect of their research 
use of the compute^ into a form suitable for instruction. For example, a prof esscr 
who used the computer to simulate genetic phenomena in botany prepared exercises 
which enabled his students to interact with^ selected aspects of the same 
simulation model employed in his research. Through thi's approach, students were 
given access to and practice with some of the research tools which the professor 
used in his own work, 

' _ m 

Since 1965 seminars and related author experiences have'beexi offered to all 

departments and schools. During the past four years faculty from history and 

< J 
classics as well as the science and professional f ielUs have partficipated. 

Seminars are small (six to eight participants) and are staffed by two or three 
persons who have experience with computer instjixctlon facilities now available 
to U-M facultv. ^iT^group^^ placed on critical review of 

proposed learning exercises and the generation of ne«? ideas. During individual 

work and cons^iltation sessions each individual tests his ideas on a computer. 

1 ^ • 

* 1 - * * 

Atithor Experience . 

The development of instructional materials for comptlter-bas»^d systems is being 
pursued in [many areas of liberal arts and professional curriculum, among them: 
physics, engineering, ^architectur,e, education, natural resources, public healthy 
history, library scieuce, economics, biology, and psychology. Languages designed 
for authors! (e,'g, , COURSEWRITER, PLAnK, and FOIL)^ are easy ta learn and use for 
tutorial instruction, but, correspondingly, the sequences prepared are oft-en 
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simple in i>crategy. An author 'wishing to implement interesting teaching 

strategies and sensitive recognitibn of student responses must add special 

functions to the "author" language'. The programming thereby becomes complex; 

authors are advised to write specifications for an instruction sequence in any 

convenient but unambiguous way, and they must rely upon a technical assistant 

to translate the instruction into jsome "author" language or a more flexible 

translator, '* . ' - \ 

- ■ ■ ; ■ \ 

i 

A notation is evolving through which authors can give written instruct:|on3 to • 
a technical assistant who codes the material in one of the available languages* 
CRLT provides such assistance to U-M faculty or al amatively trains writing 
assistants already Experienced in the subject area. One long-range ^goal of the 
CF^LT program is the development of a flexible translator, or a system for 
writing translators, which will adapt a cpmputer language and related support 
to individual au):hors and subject areas, there^by reducing the need to work 
through technical assist^ants. ^ * ^ 

As soon as an author has successfully executed a shbit learning exercise on the 
computer, he is encouraged to have a student try the material and strategy. 
The author can revise his first draft on the basis of the ^tudent*s performance 
and then have another student try the improved version. Typically, a cyfele of 
\test and revise is repeated with students a number of times before the author 
is satisfied that the exercise is ready to be put to use by students regularly 
enrolled for instruction* . ^ 

A Strategy for Development 

Collaboration of a prof essor.^with GRtT on instructional projects follows a 
typical pattern ^ The -initial specification of goals and the development or a 
short instructional sequence or exercise are supported by CRLT funds and staff 
efforts; If the faculty member chooses to continue developmental work v?j.th 
computers in instruction he is encouraged to requesf technical assistance, computer 
titne,*and materials from the Wolverine Fun^, a source of support for innovative 
instructional activities within ^the University. 
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Wolverine Fund support usually carries the project until the materials, are in a 
form suitable for use within a class. Operational use of the computer for 
regular itistructipn is supported by the academic depar^^nLilith University 
resources. Often the professor obtains outside funding to expand research and 
development, efforts for 1) a wider utilizatiou^oC the computer within his 
discipline or 2) a revision of the curriculum incorp<5rat4.ng computers* 

At the conclusion of a sponsored reselirch project the department again provides 
support forHliose opera tionk which are justified for^tudent use as^^^n integral 
part of the currlrc^lum* ' _ . * ^ 

Computer Networks for Instruction 

For- more than five years the Center has been involved in long range* planning of 
inter- institutional applications of computers in instruction, A network involving 
the three largest ifniversities in the State (Michigan State University Wayne 
State University ^d the University of Michigan) has been developed through* the 
Michigan^ Interuni^ersity Committee on Information Systems '(MICIS)* The 
cooperative endeavor of the three institutions to develop and implement a 
prototypt -for instructional computer usage in the state is strengthened by the 
incorporated Michigan Education Research and Information Triad (MERIT). Ultimately, 
most universities, colleges, schools and perhaps some state agencies will share 
certain facilities for instruction that would not otherwise be available to them. 



Karl L. Zlnn - . 

Research Scientist 

Cen terror Research on Learning and Teaching 

Ann Arbor, Michigan ^! ^ , ^ 

May 15, 1970 . ^ ' 

__/ * 
Reference 

Zlnn, Karl "Programming Conversational Use of Computers for Instruction," 
pp. 85-98 In Proceedings of the 1968 ACM National Conference . Princeton: 
Brandon Systems Press, 1968. Reprinted in R. C. Atkinson and H. A. Wilson, 
Computer^Assisted Instruction: A Book of Readings . * New York: Academic 
Press, 1970, pp. 253-68. 
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Kiewit Computation Center 
Dartmouth College 
^Hanover, New Hampshire 03755 

Convinced that ^11 l-.berally educated students must^l^e exposed to computation 
and know how to deal with it, Dartmouth College ±p 1964 constructed a time- 
sharing system op,en to al^ students and faculty.' Recognizing that the vast 
majority of- students could np^' --ra^c^l^-ih^o'ugh conventional, card-oriented 
batch systems, time-sharing/^v??t6 terminals^in places convenient to students 
was deemed necessary. In/addition, a vep^ simple user interface was provided 
and a new language, BASI^, developed. / ' ' ' . 

y . ^ - ' ^ 

h / I 

-* / 1 

The main emphasis of the Kiewit Center has been to provide high quality and 
easy-to-use service ::tb* as many sX^^^nJts and teachers as possible on both the* 
college and secondary school l^els. By mid-1970, about 200 terminals, mostly 
teletypes, ^ere, in place in 35 secondai^ schools and 15 colleges besides 
Dartmouth. Most of these are active during peak periods — about 135 can 
operate simultaneously ~ and a typical day ^during the school year will see 
a total of 1000 terminal hours recorded and about 10,000 ''jobs'' runs. 

t^ile the main purpose was to provide service to the whole community, it was 
Qarly recognized that oiganized^\^?rts.at curricular materials devexopment 
was necessary if the use of th^ computer were to progress beyond the obvious 
first examples. Igerefore, ^^cH major project at the Kiewit Center included 
a materials development aspect. The principal projects are suimnarized 
below, together wit!, a brief description of the materials produced. 

> 

1.. Original Development Projec t (to develop the time-sharing system , 
and the BASIC language) Produced ^a manual for BASIC, and five teach- 
ing supplements i^or number theory, statistics C2) ^ logic and linear 
algebra. • ^ ... 



December 1970 . . . Project CLUE 



/ 

I App B Representative^Projects ' '23 



2» Secondary. Schoo l Project Produced about 35 "topic outlines'* about 
eight of wJiich were published for regular distribution and use by, 
students ^nd/or teachers. In addition, the project produced one book, 
Elementary Functions , and one longish introductory text. School Basic . 
A proposed continuation of the project will produce about six more 
short curricular units. • ^ 

3. College Consortium Project * The main purpose was to provide ser- 
vice and reco,rd the nature of use in the participating schools. No 
n^aterials as such were produced. . - ; , " 

Recognizing that the broad spectrum of uses in the curricula experienced^in 
the Dartmouth ^network fell far beyond the^ traditional understandings of CAI, 
a new Center ha^^een established at Dartmouth. The Computer Educational 
Materials Development Center will encourage a wide variety of curricular 
uses and materials development, aild will provide the crucial summer support 
and technical editing assistance necessary to bring the materials to usable 
devels of .quality. 

- ■■ ' ■ ■ i\ 

Professor Arthur W. Luehrmann ^ 
Director, Project COMPUTe 
Dartmouth College 
Hanover, Ne^ Hampshire ■ . 
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Illinois Institute of Technology , ^ 

Computation Center 
Chicago, Illinois 60616 

The Illinois Institute of Technology hao long recognized that the computer m 
represents an emerging new dlsciplilie which impinges on other academic areas. 
The University's computer operations are therefore set up within an i'nter- 
discipiinary Computation Center which is divided into an Information Pro- 
cessing Center and an Information Science Center. The Information Proce^ing ■ 
Center, a service facility, oper.-ites and maintains computer equipment and 
provides advice, counseling, analysis, and programming support to computer 
users. The Information Science Center, an established part of the IIT 
academic program, carries out' research and/teaching in the field of high^ 

4 

speed compucers. ' ■ 

Through m Information Science Center, IIT offers graduate instruction 
leading to the degrees'of Master of Science, and Master of Science for 
Teachers in Information Science. The Information Processing Center's com- 
puter facilities are used by other academic disciplines for graduate research. 
Under|raduate students interested in the field are encouraged to develop 
strong minors or co-majors "in Information Science. All undergraduates at 
IIT are required to take at least one introductory computer course. More 
than half of all' undergraduates use the center's computer to support their 
course work during any given year. In addition, the center teaches and works 
not only with, the university students but teachers as well, underscoring the 
fact that education for the modem man or woman, including the teacher, is a 
lifelong process. 

However, IPT's efforts to find ways of effectively bringing computers to the 
classroom are not ijestrlcted to the university itself or to universities 
in general. IIT has, in fact, given special and continuing attention to the 
need for .systematic d.evelopmeift of computer-related courses of study below 
the university leyel. This has Involved pioneering in the.adaptation of 
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high-speed computer systems to support large numbers of educational users 
wlth|small.prpbJems and programs. ^ 

The layman tends, to regard the computer as too complicated and too expensive 
for ,us^ by ^nasses of non-university students. But programs operated by IIT 
have demonstrated that neither the aptitude of students (or their teachers I) 
nor the cost of processing {programs need necessarily be barriers to the use 
of computers in secondary and even elementary schools. 

Since 1961, for example, the university has ^conducted a Saturday Secondary 

School Computer Science Education Program* This program has brought 14,000 

students and 1,200 teachers from more than 400 high schools in the Chicago 
♦ 

metropolitan area to th.e university to learn how to program a computer. 

Initial participation in this program by two Chicago public high school's led 
to acquisition by the Chicago Board of Education of a copy of an early IIT 
computer system to support all 60 of its high schools. This was further 
enhanced by the fact th^t 200 Chicago high school teachers participated in 
the IIT Saturday programs. 

Highly motivated, average, as well as above average, students have shown 
themselves fully capable of learning computer programming. Through a series 
of Saturday academic programs, at the University, 10 per cent of the secon- 
dary students taking th^ introductory course have continued with advanced 
Instruction in computer applications. 

Both students and teachers pay a fee to attend the Saturday program, but the^ 
charge is nominal, primarily due to the fact that IIT is able to provide ' 
significant computer experience at a program processing cost which is signi- 
ficantly less than that of circulating a book from a public library. The 
cost of circulating a library hopk is estimated at 60 cents. The cost for 
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computer-process in^a student or teacher problem at IIT is less than^5 
cents* 

This low-cost processing is a result 



cation programs designed forj^ maximum 



5f several factors. The IIT Compu- 
tation Center, for example •has engaged in extensive development of appli^ 



iccomVdation of computer capabilities 



to the educational environment* The jCent^ has also developed a Remote 
.Job Entry System which makfes it possible for a wide variety oE peripheral 
equipment - card readers in the Center's data preparation area or teletype- 
writers in a separate laboratory - to communicate directly with a computer. 
This system uses economical batch processing methods under the control of / 
an automatic' scheduler while providing users with complete access to tne£^ 
full range of application programs stored in the computer's library, in- 
cluding many developed by the users of the IIT network. 

In addition to software development, providing remote terminal access at very 
low cost, IIT has developed a comprehensive third generation' language and 
supporting compiler. * Called IITRAN, this modern language, which is designed 
to supuorc classroom instruction, provides extremely comprehensive diagnostics 
which enable students to master prograimning in the shortest possible time* 

Through the use of a viable subset'of IITRAN, high ^hool and college students 
are, able to learn programming and begin using, a computer productively after 
only one hour of instruction. The cost of computer time for an average 
student job is also reduced to a minimum. At the same. time, experience with 
the language provides students with a firm basis for learning mor^ restric--^^ 
tive*, commercially used programming languages. This is because one of 
IITRMJ's design. objectives is to teach students basic programmir^ boncepts 
without the arbitrary restrictions of^languages like FORTRAN, 

„IITRAN has also been translated into foreign languages. Formerly, non- 
English speaking studenlfs studying in the United States hadJ:o learn both 
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the English language and a programming language to use a computer. Now, 
through the use of S.PANTRAN, GAULTRM, and DEUTRAN, Spanish, French, and 
German speaking students' can become familiar with the computer in their 
native langiiages. What's inore, the comprehensive and explicit error messages 
built into dach of these equivalent foreign language compilers essentially 
convert the computer into a teaching machine for instructing foreign-born • 
students in the use of the corresponding programming language. 

Based on these programming and processing capabilities, IXT began a new o 
^computer educational program called Operation Coiapu-Tel in October 1966* 
This program uses all of the know-how developed by the IXT computation Center / 
to bring the computer ^into rerapte^ classrooms via telephone lines. A tele- / 
typewriter installed at each participating educatiSnal institution is used' 
^to transmit problems directly to the Computation Center's computer and type 
out results 4ed back. from the computer* 

In July 1968 the National Science Foundation (NSF) awarded a "grant to IIT and 
nine other participating colleges an<d universities in northern IlliTiois and 
southern l^isconsin to develop a regional computer network. The IIT-centered 
Project is the largest ^f 15 regional ^computer networks spanning the United 
States arid partially funded by NSF. Each regional center emphasizes 
different aspects of computer-based: educational activity* At IIT, computer 
hardware-software and programming training are de-emphasized ^since these are 
areas in which the university has already obtained considerable experience.' 
Instead, I^^^'s 26-month project .seeks to impact education at the under- 
graduate level through a planned cooperative^ curriculum .development program. 



Seventy-two faculty members from a current totaliof 15 ^participating insti*- / 
tutions Me grouped by seven academic discipline^, to do curriculum development 
work under .the guidance of seven group leaders. The seven academic disciplines 
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are biology, business-managementWonomlcs, chemistry, mathematics, physics, 
psychology-education, 'and sociology 

The group leaders visit participating\colleges at least once a term to^ 
assist in planning t^e use of computers'^^ithin each individual college's 
currtct.lum. The leaders are also encoar^ed an| funded to attend .relevant 
conferences and to visit other leading InsWutions around the country to 
dearn more about" how their academic disciplines are being enriched through 
the use of computers. I 



\ 



\ 

\ 



o 



Mr. Peter Lykos 

Director,. Computation Center 

Illinois Institute of Technology 



_ December 1970- 



Project CLU£ 



ERIC' 



I App B Representative Projects 



Nortii Carolina Educational Computing Service 

Box 12175 ' ^ 

Research Triangle Park, N. C*, 27709 ^ * ^ 

# 

The North Carolina Educational Computing Service (NCECS) wa3 created by the 
State^-Su^d of Higher Education in July 1969- to provide computing service 
to educational institutions throughout the St^te* NCECS is the successor 
to the North Carolina Computer Orienta,tion Project (NCCOP) , a grant-supported 
program ^hich began in 1966 and termi^^ted officially in October 1969. y^^^^'^^^ 
Utilizing the facilities of the Triarigle Universities Computation Center 
(TUCC)*, NCCOP 'brought remote computing to the campuses of forty-three in- 
stitutions of higher learning and established one of the first intercollegiate 
computer networks in the United States* Most of the /institutions which. t9<^ 
advantage of the NCCOP .of fer of free serv,ice elected to continue the computer 
terminal at their expense when the orientation period terminated , creating a 
^continuing need for a central organization* ' ' 

The 'Computeo: Orientation Project was an experiment. The objective was to 
see how many -of the 9i)_eligible ins 1 1 tu tiojai_^o^ld participate and how many, 
when* they got to fhe end of the^ir one-y^afi^sf re^ J^r ial , would be willing to 
put their o^ money into computing activit^esC^'A few already had on-camptfs 
computers. Thirty-two of * the 43 institutions retained the terminal after the 
free period expired, assu^ng^pll associated costs, and most of these, have 
continued temote computing wiM^dut interruption* Moreover, the project throug 
its regional meetings, workshops^ and publications, had a broader effect on 
high^ education .in if or th "Carolina in t>hat it created, and strengthened inter- 
est in academic computing at many of those colleges which never accepted the 
of f er .of free/sluice ♦ ^oWe of these have since joined the network, and 
'faculty members from others are particijating in a cooperative program of 
curriculum development. 



*TUCC is a non-prof it corporation jointly owned by the University of North 
Carolina at Chapel Hill, lJo'rth> Carolina State University^ ^nd Duke University 
and is equipped with 'an IBM Sy^t:em/36G Model 75 computer. 

*2 - ♦ 
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NCliCS is a service rather/ than an experimei|t. Past experience proved^ that 
the small user— in particular, the low-speed termina; user—requires special 
technical support, and needs to be represented by TUCC by someone who is 
primarily concerned with his needs. NCECS serves^as the representative of ! 
all. educational users other than the owners of TUCC. It provides these 
institutions with a low-cost computing service (including terminals, communi- 
cations and computer time) and the necessary technical support (including 
information services ,\ technical assistance to users and specialized software 
'and documentation), -^he central staff currently consists of nine full-time 
and two part-time employees. The network now includes forty-two public and ^ 
private institutions— universities, junior and senior colleges, community 
colleges and one high School system*, 

.1 - ■ .- ^ - ■ . 

In November im the Boird of Higher education received a two-year grant of 
$344,000 from th^atiorial- Science Foundation for suppettAf NCECS. This 
ferant made possible^ an expansion of the centra^l sfaff, together with a 
variety of flew .activitie& in the area of curriculum development. Twelve 
colleges in the network also received NSE grants (totaling $131,0,00) for the 
support of on-campus facilities. During the 'past year, the^e and other 
participating institutions have been able to acquire n)0re powerful terminals^ 
and- users have been exposed to neW f acillities and p^vided opportunities f or^ 
more sophisticated usage. Thus their needs 'for technical support and 
specialized documentation, rather than diminishing, have continued and 
expanded. There'haa been, however, a shift in emphasis from basic prpgram- 
ming Instruction to advanced training in the^use of neWly available% Tmore 
sophisticated facilities and in applications of computer use 
computing curricula'. 



in hon- 



*Terminal equipment includes 16 Teletypes, 25 IBM 1050' s. 8 j[BM 2780's, and 
one IBM 1130._ Thre^BM 2770* s are scheduled for installatijan in 
October 1976.^^ 

- ■ ■ ■ ■ ■ • ■ 'I- ■ 
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.Curriculum development has been initiated by NCCOP with the formation of 
e^ght discipline groups and the organization of several workshops to bring 
these groups together. Dr. Joseph R. Denk^ chemistry group leader for 
KCCOP, was'addecPto the NCECS staff to supervise curriculum development 
activities funded by the' NSF grant. ^ * 

/ . * \ 

The curriculum development program is concentrating on five main areas t \^ 
group activities, teaching unit (CEG) production, the publication of a pro- 
gram and literature/ service journal (PALS)^workshops> and a consulting ser- 
vice» Group actiyity is cooMinated by group lea^ders from participating 
colleges* Six d/scipline group leaders were funded during 1969-70 in 
business-economics, chemistry, engineering, mathematics, physics, and 
statistics*- ..Fpur additional groups— biology, data processing, humanities, 
and soci6i&gy^-were coordinated by the central staff. To date, curriculum 
development has made its greatest inroads in chemistry, engineering, 
sociology, and statistics* 

NCECS has p'i^oduced J.1 Computer-based Educational Guides (CEG* s), with 20 
more in development* Thegi^^^dlscrpline-oriented teaching unigts describe the 
usage of a particulir^anned" program, and contain educational j^aterial 
as well as the\usual\ type of computer program documentation* T^hey^are 
tested in workshop activity before publication. ^Support wiljl be provided 
during the 19^0-71 academic year for the development of teaching units by 
group members, as well as by the various leaders. The Program and 
Literature Service (PALSf is a journal used to communicate the existence 
of programs and li^rature concerning programs In use both inside and outsid 
the NCECS network. Short abstracts of teaching units, programs, and journal 
articles are published quarterly for each discipline group. Group members 
are expected to contribute to PALS* 
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Workshop activity ranges from discipline. group meetings to interdisciplinary 
sessions Jin areas of numerical methods, simulation, s^tistics (for 
.everyone'^), and gaming.. 'Visiting scientists are a regular part of curriculum 
workshops, and a consulting service' is made available in all disciplines. 
Workshop activity is described in a recent report on "Spring Workshops in 
Curriculum Development", and general activity is reported in the bimonthly ^ 
NCECS Newsletter.. ' • ' 

» • " " " 

At the end of the two-year grant period\ many of the graht-sui>i?ortGd curri- 
culum development activities will terminate. By that time, theWsponsibility 
for continuation of this effort will have been shifted into the ^^nds of 
the colleges." However, it is expected that the central staff will 
to provide coordination of some- curriculum 'dfevelopment activity in aSdition 
to its' tecRnical support functions. • i ' ' " 



Louis. T. Parker, Jr., Director 

North Carolina EducAtional Computing S'*"'"'' 

Research Triangle Park,' North" Carolina 
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The program was guided by six general .objectives whi:h had been formulated from 
the previous Institute in 1967: 1) to acquaint the participants with the field 
of computer-assisted instruction'; 2) to provide the participants with an 
understanding of the educational and learning theories that form the basis for 
the application of computers within instruction; 3) to^'develop a high degree 
of proficiency on the part of the participants in the utilization of the FSU 
Computer-Assisted Instruction system; 4) to develop knowledge about the newer 
techniques of data analysis such as sequential analysis, tests 
for instructional models, and dynamic decision-making; 5) to learn how to 
administer CA!^. installations so that the participant would undert . . id the 
operational factors of cost, time schedule, course development and personnel; 
6) to author a CAI course unit on the FSU CAI system and xx> evaluate its 
efficiency. 

All of tfie participants achieved the Institute's objectives with varying degrees 
of success according to their particular acc^Jemic orientation as /ell as their 
personal ^oals. In general, the overall goals of the Institute were accomplished 
in that all the students who participated received graduate credit and made 
excellent grades in their formal couicse work.* During the three quarters of the 
Institute, the participants accumulated 45 quarter hours of graduate course 
work. The required courses for the trainees were as follows: Techniques. of 
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CAI Laboratory 

The University of Texas 

Austin, Texas 



The University, of Texas CAI Laboratory has J)een-involved in a broad -s^^eetrura - 
of research ^nd development activities. Two principle research efforts, have 
been ivi the areas of aptitude by treatment interaction (a two-year contract 
with the Advanced Researdk Projects Agency of the Department of Defense) and 
a five-year research prograj:i on instiructional design, authoring systems, and 
learner control (sponsored by the National Science Foundation). DevelopL.ent 
activities have included curriculum development, the development of a remote 
terminal network, and the development of interdisciplinary graduate training 
programs for instructional designers and instructional researchers, especially 
between the departments of computer science and educational ^ychology. 

Research on Cognitive Ab:ii.^ties and Learning : This research, concerned with 
the interaction between cognitive traits and instructional treatments, has 
been conducted at both a ba^ic and an applied level. At the basic level, we 
seek a set of theoretical cognitive constructs which will accovmt for indivi- 
dual differences both in measures of learning and in measures of performance 
oji cognitive aptitude test items ♦ Through' these cognitive constructs, we 
hope also to account for the interactions between aptitude patterns and 
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Programmed Instruction, Origins of individual Differences Important in 
Education, Human Factors in gaining and Instructional Systems, Computer- 
Assisted iubtruction. Computer Analysis of Educational Data, Computer Simulation 
and Information Processes of Learning and Instruction, QuantsUative Models of 
Instruction. Even more important than their success in course woTkr^eaeh- _ _ 
participant made a significant contribution to ^he research and development 
of this new professional field via the authorship of learning materials and 
the successful solution of current developmental tasks. 

The students believed that the use of the "Systems Approach'* and the 

r 

implementation of a lear.iing sequence on the CAI system were the most significant 
^^a^ivities of the Institute. 

Moreover, a survey of Institute graduates from 1967-68^ who are now serving in 
administirattve an^i teaching positions primarily in junior colleges, revealed 
that 83 per cent considered their traineeship experience very worthwhile and 
67 per cent indicated that skills learned in the traineeship are quite valuable 
in their current position. x ^ 

It is important to note that 50% of the graduates believed that the traineeship 
had provided them with the opportunity to gain a more influeAtial position in 
education than they might otherwise have oljtained. This statis^c, in 
conjunction with the trainees* perceived ef t^,ctiveness of t^e training program, 
is critical both in terms of evaluating the im»iediate effects of the Institute 
and in est^imating the potential long-^term effects Iri the field of education, 

Ihe entire program was essentially strong. Only in the areas of prerequisite 
statistical skills and computer languages does there appear a need for future 
revision in terms of the nature and goals of the Institute. 
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The weekly seminars were considered a problem by the trainees in that they 
demanded considerable time and preparation on a broad range of topics. 
Additionally, the challenge of complex quantitative analyses and model building 
left the better students with a desire to Investigate these topics in greater 
depth than was provided by the program. In the economic sphere, the participants 
consumed considerably more CAI cocputer time than covered by the budget; these 
^e^^s were absorbed by Florida State University. 

In general, the objectives of the Institute can be recotnmended for professional 
development in the area of cbmputers and education. The nine month length of the 
program allowed a thorough introduction and orientation to the nature and 
potential of computer assisted learning* A full academic year appears to be the 
absolute minimum time needed to develop competency in CaI, Communication between 
faculty and students was extensive and profitable. The greater emphasis ^on 
practical experience at an earlier time proved to be of great help to the 
participants in that they could fc^rmulate. their indivj.dual projects earlier, 
allowing more time for project evaluation; analyses, and completion. 



Adapted by Project; GLUE staff from the Final Report of the Institute in 
Computer-Related Multi-Medial Instruction for Administrators and Faculty in 
Junior Colleges and Universilties prepared by Duncan N, Hansen,) Walter Dick 
and Henry T. Lippert, July 1969 

/ 
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Beforri the advent of C^, the training consisted primarily of two major areas i 
the stand-up lecture portion and the laboratory portion which gives the students 
a chance to work on real equipment. The time distribution between these two 
portions of training is approximately 50/50. In other words, 50% of the 
student's time is involved in lecturer-type learning experiences and 50% of 
his time is involved in laboratory learning experiences. 
* 

In early research with CAI in Field Engineering Education, the lecture 
materials (re€ierred to as theory training) were prepared for presentation via 
CAI. However, *the approach taken required that the CAI materials be provided 
the student before ^he received any hands-on training in the laboratory. In 
courses as lengthy as 25 days, 12 or 13 days of the CAI^manner of theory 
training were presented before the student reported to an Education Center for 
his follow-on laboratory training. This division in time was a significant 
change from the norm^.l training sequence in which laboratory .learning experiences 
were designed to support the theory (or lecture) experiences that the student 
had'^ in the classroom. 
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npvelo pmental Activities ; The emphasis on instructional design for CAI and 
its psychological and computer science foundations at the University of 
Texas has helped attract curriculum development contracts from publishers, 
computer manufacturers, and federal agencies. The most successful projects 
have been in freshman mathematics, English, and chemistry, prevocational 
training for the educablt. retarded. 7nd the Arabic writing system. 

A netwofic of terminals. in up to nine schools and colleges in Texas and 
Louisiana connected to the Laboratory's IBM 1440 computer in 1968-69 led to 
plans for broader implementation. Consequently an attempt was- made during 
1969-70 to implement Coursewriter III and APL on the IBM 360m^omputer used 
by the. University of Texas for business data processing." This ^Hmplex 
system ^as successfully Implemented and was In operation in the spring of 
1970. As has been the case with other R & D groups in this country, the 
CAI Laboratory- expetien-^ed substantial cutbacks in funding .for 1970-71 and 
had to terminate tttt^romising project in June of 1970. Fortunately. CAl 
capabilities on theW 6600 computer housed in the University's cpmputation 
center are increasing rapidly, and through NSF funding a regional networl- 
for computation, including CAI, is being established. 
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on simulated laboratory exercises was also explored, computer programs bimui 
the experiences a trainee would have if he were working on the actual 
laboratory equipment. \\e found that simulated laboratory exercises were 
successful when the situation simulated involved the use of familiar test 
equipment, and the student had had previous practice in performing complex 
psychomotor skills ^similar to those required by the simulated exercise. 
Research studies demonstrated that Computer Assist d Instruction was an 
effective method of providing the Customer Engineer with training at his own 
branch office on a variety of subjects. 



Today, Field Engineering has a nationwide network consisting of a central 
computer vjith over 300 remote typewriter terminals located in bmch 
offices throughout the United StaiS^^^T-hete^are^currently o;ie^70 ..courses 
offered through this -system. We have develop a^MACStrCTBKARY an4_^^^ 
CONTROL PROGRAM that provide authors with §tandabi-..E55ss" Nation routin^^ 
for teaching segments, review segments, remedial segment§>>iiuiz adminis- 
tration, and quiz critique. 




We are hopeful|that as new display terminals wittT^^^^screens and respon^^ 
probes are developed, our laboratory simulation training ml!gh^«,.be Improved 
through more realistic simulation and decreased student time. Pethapsntnosfe^ 
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of our computer system laboiratory training c:n be simulated using CAI 
termiuals. 

We are also moving toward combining our theoretical training with simulated 
laboratory exercises, thereby providing practice for the Customer Engineer in 
applying newly acquired knowledge to the' solution of simulated real-world 
problems. It is our hope that in so doing we can produce more effective 
learning by combining problem-solving (simulated trouble-analysis) experience 
with theoretical material. We are also investigating the need for providing 
higher-level language that will allow an author to more readily prepare both 
tutorial sequences and simulated laboratory exercises, eliminating the need to 
learn the symbolic * rogr^imming language now used. 

Through our existing CAI system Customer Engineers receive significant 
portions of their training in their branch offices. However, we are 
pursuing research and development to improve our use of the computer in 
( i training and to improve our authoring techniques and to continue to 
explore new areas of ^application^ ^ * 



/ 



L. R. O'Neal 

Advisory Education Spec^list 
February 16, 1970 
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contrriDution to the nation *s educational program. The goals of PLATO have 
therefore been twofold: first, to investigate the potential role of the computer 
* in tne instructional process; second, to design an economically and educationally 
viable .system incorporating the most valuable approaches to teaching and 
learning developed in the investigation* 

\ _ - 

Durin^g the past nine years three systems (PLATO I, II, III) were designed and 

.builtl each embodying improvements indicated by the previous model; a network 

^ af four associated demonstration centers was added early in 1969. Exploratory 

educafc^ional efforts with PLATO systems have now involved experiments in at 

least ^jtwenty fields of study and over 100,000 student-contact hours at all 

levelsl" PLATO I and II stimulated research and development leading to the 

broader capabilities of PLATO III which was designed for optimum educational 

versatility without specific concern for costs. PLATO III, in use since 1964, 

has projvided opportunities to develop many powerful new teaching strategies in 

variousl diverse fields. Currently, work is being undertaken on the design of 

a PLATO I IV, a large-scale system which, even in a prototype version, woul(J be 

justifiable in economic terms. * 
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It has been difficult to incorporate CAI lessspns ipto the rest /of 
a normal school program, but this problem disappears in an IPI yBch9ol which 
provides individualized educational environments at all times*/ Economics is 
an important consideration, but the cost of cojaputers contini^ei to drop 
while the ability of school staff to use computers effectively increases 



exam 



pie, a PDP 15 today* is half as expensive and twice as- f^st as the 



corresponding model of the _s_ame _.size in 1965- 



/ 



For 



In the area of computer technology, there are two majnr ^jj^rohlems for which the 
project seeks solutions: 1) What should be the distribtuion of computer power 
between locally situated and necessarily small devices /and the large and 
central computers? 2) Wliat should be the nature of the Interface, between user 
and system in terms of the number and types of terminals required^ the interactive 
quality necessary for efficient student and teacher transactions with the system, 
; and their location *in the school?* f ^ . 

^ ^ • / ' 

f I ^ Using terminals dn the schopl which operate remotely on the PDP 7/9 at LRDC, 

the staff will test the hypothesis that a small local computer could support a 

terminal network at the school that would provide computer-based testing and 

basic information for teachers to monitor and plan student progress. This 

_J small computer might also prssent CAI lesssons developed for teaching rneclflc 



laboratory as well as classroom work is possible* 

Evaluating educational effectiveness is still difficult since the data sample 
is limited. For a typical course, data on PLATO' III have been limited to 
several hundreds of hours of student instruction, .However » the results so . 
far have been^most encouraging*' and two cbnclu^ons seem justified : 

^ ^ \ 

!♦ That computer-based education 'is a plausible approach to 
improved individualized instruction in a very wide array 
of course^ or subject material areas. 

2. That the nature of educational testing and evaluation 

requires, and will be radically affected by, the availability 
of large computer-based education systems; a valid measure of 
' effectiveness calls for a much larger sampling of data and a 
longer period of comparison than has heretofore been available. 

Those developing and implen^nting PLATO visualize a particularly valuable role 
for computer-based education at the undergraduate level at universities, 
four-year colleges, and community colleges. They believe that a computer 
system would assume a widely varying fraction of the instructix>nal load. In 
' certain instances, such as introductory courses in computer science, mathematics. 
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-successful •Installation of computer support for IPI will Increase the 
flexibility of the IPI procedures which are so necessary in such curriculum 
areas as science and social studies* 



Adapted by Project CLUE staff from a paper by William Cooley in 
Journal ofEducat ional Data Processing, 1970, 7, 
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basic anatomy, or genetics, a PLATO-type system might well assume the entire 

load. In additipn, theye would be. many courses in, which the computer-based 

system would share the /load more or less equally with human teachers. \ 

Faculty instructors cc/uld =pend more of their tim4 in advanced or interdisciplinary 

seminars in which the/ discussion of human values /or the development of new, 

ideas would occupy the entire, teacher-student relationship. 

In the second major /area, the economic sphere, presently available CAI systems 
(including PLATO 1^4) entail total costs which prange between $2.00 and $5.00 
per student contact hour. The PUTO IV system ks intended to reduce this cost 
by approximately a factor of ten, to about 35 cents per stuSent-contact hour; 
this figure is comparable to Che lowest instructional costs in elementary 
schools and' considerably less than comparable costs at colleges and universities. , 
From a budgetary standpoint, then, the operational cost' of the computer-based ^' 
education system corresponds to the direct instruction cost in the conventional / 
setting. With regard to the separate item of software, the PLATO III software 
system was designed with a special view to ireducing the oyerall effort and 
associated cost of materials preparation^ ' »...„■ 

The design of PLATO IV envisages .a computer-based system which could reduce 
the total cost per student- cent act hour by a large factorbelow that of any 
system currently available while maintaining the unique student terminal and. 
system software capabilities demon^rated in PLATO IM.j In summary, the costs, 
"for the installation of the computer (including systems /software) and the 
management of the c^dmputer center would total approximately $1.2 million per 
year, or about 15 cents .per student-contact hour. If/ a comparable amount were 
associated with the rental of the student station arid associated communications 
lines, the hourly cost for individual student instruction would be less tTian 
35 cents per contact hour. 
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Tl/e cumulative and overwhelming trend of ex.plorat^ory research results with 
the PLATO III system suggests that this new medium will be educat'ionally 
Effective ^nd enthusiastically received by students at all levels of age and 
ix'perience. T: fere is .every evidence thus far that this enthusiasm is shared 
/by teachers and authors as well.- 



Adapted by Project CLUE staff from a Progress Report on the PLATO Program 
prepared by D, Alpert and D. Bitzer ' \ 
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The Computer Assisted Instruction Laboratory 

Center of Studies and Applications, in Advanced Technologies 

(Centro Studi e Applicazioni in Tebnologie Avanzate) 

Bari University, Italy ^ 

The Center of Studies and Applications in Advanced Technologies (C.S.A.T,A.) 
was established in May 1969 and operates at Bari University. It is supported 
by several I:.alian agencies and industries interested in promoting researcir , 
and development activities in the south of Italy, 



A major interest of the C.S,A.T*Ai is the development of instructional and 
research programs in the computer science field. These programs^ concern two 
closely related aspects: exploration of th^ use of the' computer in education 
and the development of materials explaining how the computer is used in 
education. T'he CAI laboratory makes *use of the C,S.A»T.A. equipment including 
IBM 1130, 1800 and 360/65 computers. There is a continual effort to 
coordina{:e cioseiy the research and d*evelopment programs of the CAI laboratory 
with the Center *s more general activity in the computer science field. Thus, 
the laboratory utilizes when possible the methodologies of all other research 
groups operatil^g^^n C.S.AtT.A. , namely, the group developing Information 
storage and retrieval techniques, the group working on numerical and statistical 
analysis automation, and the group Investigating^ pattern recognition techni- 
ques and methods. 

Research at the CAI laboratory focuses on three important aspects of the 
computer's role in education; as an administrative device, as a logical and 
-computational tod— used by technical-professional people, and as a direct 



factor in an instructional system* Thus, at the laboratory, the terra CAI 
is used in its broadest sense and takes into consideration functions common 
to other computing systems, for example, storing, retrieving, processing, 
disseminating and creating information.^ 
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Staff have conducted courses for undergraduate and graduate students, outlining 
the b^sic logic of data processing systems, programming languages (PLI, FORTRAN, 
Assembler) and some of the basic methodologies of the information sciences 
(numerical analysis, simulation, mathematical programming, methods of information 
managements) • ^ 

Staff members working on instructional use of the computer for computing are 
concerned with the development of conversational systems and mathematically 
^oriented languages. At present they are researching a) a conversational systqm 
for experimental data processing; b) a language f(^r formal computation; 
c) a language for mathematical programming; and d), the . definition and the 
carrying out of a new conversational system for automatic numerical analysis 



and of procedures f^r formal computation. The results of these activities 



may provide the foundation for using the CAl system for problem solving and 
simulation in University curricula* 

Instructional use of the computer as a medium is being Explored with attention 
focused primarily on th^ purely technological aspects of: defining suitable 
languages for the student-machine interaction and their use in some experimental 
applications, implementifig more flexible methods of Analyzing student response 
and developing methodologies for course management. The students-computer 
interaction is accomplished through a language by means of its text-processing, 
diagnostic and computational ftfnctions. The different kinds of languages 
actually used belong to two main classes — computational and text processing* 
Staff at the e*S.A,T. A. laboratory have studied two languages belonging to 
these classes (Coursewriter III and APL). 

Staff at the CAI laboratory define three general areas of research and 
development which they intend to ^explore in the future; 
1. Comjuter Science and Instruction 

a) the inauguration of training programa for computer technicians and 
users , 

b) the development of new undergraduate and graduate degree programs 



Project CLUE December 1970 



46 



; I App B Representative Projects 



Instructional Use of the Computer for Computirfg ^ 

a) the development of suitable facilities and protojtypes .of use in 
courses 'to facilitate convenient computing for students 

^ - using AP.L, FORTRAN^ PLI for problem solving ^ ' 

using APL In simulation laboratories 

b) the establishment of a research center and consultation services 
to facilitate general student and faculty use of advanced 
application packages in all schools of the 'University 

3. Instructional Use of the Coi^uter as a Medium 

a) the development of system programs 

b) the development of a demonstration center fur instruntional 
. techniques and cpWse strategies 

c) the development of expertise in computer managed instruction 
by means of a prototype course development project 

d) establishment of a center for instructional evaluation • 



Adapted by Project 'CLUE staff from a report prepared ^y Professor A* Romano 
for the IFIP World Conference on Computer Tdiucation jl970 ^ 
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branch in any "real" CAI program. Instead, we adjust instructional treat- 
ments constantly on the basis of moroent-to-moment response topography. 
Nevertheless,, since we are faced wi'th the task of producing quality compu*-or- 
based instructional programs, often under contract, we must provide the 
instructional designer wijh some form of guidance even in the' absence of 
■ theorems of instruction. Ou'r approach has been to give him a pragmatically 
useful "instructioital design model" (Bunderson, in press), which serves as 
a quality control and management system for CAI program development. This 
instructional design model prescribes a sequenc f activities, each of 
which produces a specified design producVuseful in quality cpntrol. The 
model provides a systematic structure within which hunches, heuristic guides, 
intuition, and other presently non-specifiable bases for designing cer.-.ain 
variations .i'nto instructional sequences can be channeled an^ made subject 
to quality tests. The primary factor in quarity control is the intensive , 
use of* student feedback- at all stages of program development. By a time- 
consuming iterative process of tetxting and revision, an ^tflcient program, 
adaptive to a wide range of individual^differences, can ^^)e developed. 



At the more applied end of this project, then, we leek' ways of defining 
"treatments" and "aptitudes" as variables which can ^'e defined and manipulated 
not only by the laboratory researchers but by the i^ktructioaal designer who 
works with- the guidance of the design model. At th^ other extreme, we seek 
through investigations employing laboratory concept and rule leavning tasks, 
and well-known Cognitive abilities, to tie our efforts to the body of 
research -and theory in the psychology of human learning. Studies employing 
the "Science of Xenograde Systems", an imaginary set of concepts and rules 
about the behavior of an atom-l'lke lawful system, represent the more applied 
efforts 'within this project, while studies employing concept problems, 
pair-asso'ciate lists, and other lAoratory tasks, represent the other 
effort. 
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In the case of either task, the approach we take is the same. First, a 
careful analysis of the task in terms of its requirements for efficient 
information-^processing is undertaken* This analysis forms 'the basis for 
specification of cognitive aptitudes most likely to be related to the task 
requirements, and of treatment variables which might alter the task such 
that the relationship of certain arptitudes to performance can be changed 
in predictable ways. Predictions derived in this manner are then tested 
experimentally, ^ 

^ NSF Sponsored Research Program in Instructional Design ; The emphasis of 

this program of research, now in its second year, was summarized in the 

abstract to the initial proposal* 

Engineering groups in both academic and industrial laboratories 
are working to bring about cost breakthroughs in hardware, i^e., 
.memories, student terminal devices, and communications* The 
University of Texas Computer-Assisted Instruction Laboratory is 
working to bring about signlfi^nt improvements in both costs and 
effectiveness in authoring sys^teSj i.e,^ instructional design, 
instructional theory, and computer aids to authoring. The so far 
elusive cost-effectiveness benefits of CAI will not be realized 
until advances both in hardware and authoring systems are 
achieved, 

A spectrum of R & D activities from the basic to the applied has always been 
a feature of the CAI activities at the University of Texas, It has been 
felt tliat the questions asked in learning and instructional research should 
be influenced by the needs of instructional designers for theoretical and 
empirical guidelines. It has b^en felt that systems research and develop- 
raent from the computer-science side should also be influenced by the needs 
of authors and instructional designers, and by the findings of learning and 
instructional researchers. Projects undertaken in support of these program 
aims can be summarized according to the following outline. 
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I, CAI Program Design as Influeaced by Modular Prog^mming 

A. Definition of Program Structures for Diff^irent Content Areas 

B. Design of Author Input Systems for Defined Program Structures 
C/ Evaluation of Costs' and Benefits of Al^^rnate Designs^ ^ 

II. Research on Learner Control and Task Structure ' . 

• / 

III. Systems Research and , Development 

/ 

A. ' Research Toward Natural Language^/- TAI 

B. Software to Generate Course Code from Author^jBpu-t-'-Systems 

C. Toward the Design of a Better CAi--ifirtHor Lang^e-~~^__ 

IV. Studies in Implementation 

A. '^AI in College of Education Academic Programs 

B. A Remote Terminal CAI Service Facility 

This outline is designed as a heuristic device to reveal the logic of our 
activities under f;his program as well as to summarize projects. Thus, it ^ 
will be^s4en that some projects fall under mor'e than one heading, depending 
on the, stage of their development. For example, a modular program' structure 
in a specific content area may lead -co the definition of a paper and pencil 
or on-line author input system, which -ny lead to a preprocessor for pro- 
ducing the CAI code. 

A theme of the research effort at the-^Univer«ity.of Texas (UT) h^as been 
that cross fertilization between computer science concepts and methods 
and education (instructional design and educational psychology) will lead 
to decisive Improvements in instruction^ lor students, and toward the 
definition of a new "hard discipline^' of education which will produce 
ultimately a new set of education j^rofessionals. Pro'jeets completed or 
underway as of September 1970 are summarized in a recent report (Bunderson, 
Simmons and Judd, 1970)' • 
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Computer Support of Individually Prescribed Instruction^ 
Learning Research and Developraent Center (LRDC) 
University of Pittsburgh j 

The goals of a recently initiated project at the Learning Research and 
Development Center (LRDC) are: to study^^how the computer can best support a 
school designed along the lines of individually prescribed instruction (IPI) ; 
to integrally incorporate CAI 'lessons into the rest of the school progr am; to 



determine how much support a small computer such as a POP 15 can provide in an 
individualized elementary school; to ascertain what functions it can perform 
as a stand-alone configuration; and to estimate the possibilities of using it 
as a satellite system in a computer network, in which a l^rge scale computer 
performs the major data processing task^ required. 

The ne>4 project at LRDC is an exciting effort, to integrate two major research 
and xfevfelopment areas, IPI and CAI. Since 1964, LRDC has been developing 
anti testing individually prescribed instruction (IPI) at the nearby Oakleaf 
/Elementary School. The IPI work involves curriculum de^^gn, text development 
andt specifications for management procedures and has already become widely 
known* 

i 

For some time the IPI project has used a remote computer, but toward the end 
of 1969, staff began assembling a small local computer facility for the Oakleaf 
School. When implemented, the facility will provider 1) a computer management 
and information system; 2) a computers-administered, criterion--referenced , 
testing system for the guidance of students through the curriculum; 3) computer- 
administered exercises for basic skills and concept learning to supplement the 
other educational resources of the school; and 4) data for curriculum research 
and improvement. 
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Project IMPACT ■ 
HumRRO 

Alexandria, Virginia 

Project IMPA'6t (Instructional Model Prototypes Attainable in Computerized 
Teaching) is an integrated, multidisciplinary CAI effort. ■ It was initiated by 
the Human Resources Research Organization (HumFOlO) under initial sponsorship of 
th e U. S. Army. The objective of the^ effort is^ to evolve, throug h cyclical 
development and, evaluation, an effective, efficient and economical comp uter:: 
administered instructional system . ^ 

Problem areas addressed include computer system capabilities, CAI language 
needs anc* potential, and of prime importance, the meafiing of instructional 
strategies and their relationships to learning processes'. The professional 
staff (presently totalling 18) includes specialists in behavioral science, 
electrical engineering, computer software, instructional programming, and applied 
mathematics* 

Rationale ■ \ • ^ ■ 

CAI Is the leading operationally defined edge of a model for individualizing 
instruction. It represents the potential for accomplishing a quantum leap in 
' adapting instruction to the momentary 'meeds and capabilities of the individual 
student. The capacities of modern computers clearly provide some of the 
prerequisite tools: ' vast storage, rapid processing and retrieval, precision . 
of control, and extended comsiunication. But mere presence of these tools in 
an instructional system is no guarantee of improvement. The total instructional 
system must be taken into account. The problem for any instructional agent 
(human or machine) is to take optimal action in line with an overall "best" 
strategy for transmitting uniquely relevant information to the student. Of 
necessity, recurrent decisions concerning these instructional actions must 
be made relative to 1) the subject-matter being taught, 2) the specific 
student, 3) the momentary circumstances and 4) the available options (communication 
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channels), if specified proficiency criteria are to be attained effectively and 
efficiently* 

The potential of CAI will only be realized with a systematic, persistent, and 
iterative scientific effort leading to a synthesis of| principles into a potent 
model of the instructional decision process. With this realisation the new 
system of instruction can be molded into a cost-effective system. IMPACT 
addresses itself to furthering this realization, 

Approach 

The total instructional system noted above is considered in Project IMPACT over 
four phased development cycles. The heart of this tptal system CAI effort is 
the iterative development and testing of instructional decision models (IDM*s). 
This cyclical approach takes. shape in a cybernetic system in which the set of 
control processes continues to be. refined from, the input (student data) and output 

(criterion performances) relationships ,o.f„ the, successive IDM/.s* Within any given- 

versioiT, these control processes? are embodied in the particular decision-making 
rules incorporating system experience ga^iiBd up to that point. ^ 

Over the four cycles of development and testing, the four prongs of the effort 

* 

(hardware, software, subject-matter and IDM) are revised and updated. The 
first two cycles comprise respectively the development and evaluation of* the 
"breadboard" (preliminary) CAI system* Synthesis and implementation of the 
refined components into a prototype,* operational „ CAI system is to be undertaken 
in cycles three and four. ^ . • - 

Progress ^ 

General ; The first cycle, assemblage and shakedown of the "breadboard" system, 
is now almost complete. Limited numbers of students are continuing to be run 
in order to- "debug" all components. Extensive data collection, evaluation, and 
revision of this preliminary system is scheduled to begin in July of this year. 
A film describing the IMPACT approach has been developed and is available upon 
request. Detailed accounts of the initial, technical developments are l^^ted 
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at the end of this note. One major difficulty encountered has been a funding 
reduction which has led to a slowing of the overall progress of the effort. To 
help compensate for this a major activity has been preparation and submission 
of proposals on decision modeling to potential sponsors ojther than the Army. 
To date this has resulted in additional support from the National Science 
Foundation and the James McKeen Cattell' Foundation. 



Specific : a) A first-cut, minimally sophisticated, IDM has been designed,^ 
; ' programmed, and awaits evaluation (see Seidel, et^ al , 1969 (b))* Factors 

I currently included are ' 1) general atid specific pre-course student characteristics 

I of education, aptitudes and achievement, 2) within course history of momentary 

I and cumulative progress, including motivational indices, and 3) mapping of 

I subject-matter structure. The initial IDM incorporates estimates of student- 

f confidence and^ use of student inquiry (through a glossary technique), 

t b) The main frame of the hardware Is an IBM 360/40 with 256K^core, 

lo 2314 disk drive, and high speed card reader, punch and jnagnetic tapes. The 

I provisional configuration includes completed construction of twelve functioning 

I \ student stations with Sanders CRT and visual projector allowing single frame or 

\ variable speed,! motion presentation (Perceptoscope) ♦ The standard response 

capability is keyboard and light pen* As part of the effort to expand channels 
of communication between student and the instructional decision model a preliminary, 
operating version of a speech recognition system h'^s been added to one terminai. 
Efforts ate underway^ to ref .ne the system for multiple speakers and to expand the 
vocaj^iii^y capability from 25 to 100 vjords* Ten specially constructed interface 
controllers are currenl^ly being installed to permit integration of the display 
devices from different manufacturers* Hand-printing capability using an electronic 
pencil on a Sylvania Tablet has been experimentally installed in one student 
station. 

c) 'A COBOL course had been developed in three levels as the 
^ instructional content for cycle one. Debugging and implementation of a course 

dud decision model within the computer system is currently being accomplished* 
A short, self-contained course in Authoring Techniques has been developed. 



o 
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d) Modifications to Coursewriter allowing compatibility with a CRT 
operating sybtem have been implemented* A set of supervisory programs and 
subroutines (called Zeus) have been designed and implemented to handle I/O, 
command processing, task switching, and other det^^^ ^qt Coursewriter in| the 
IMPACT system. A set of Authoring commands has been developed and implemented • 
A system of programs for off-line text manipulation and control has been designed, 
programmed and implemented, as has been the IMPACT Data Evaluation System (IDES) 
for retrieval, analysis, and summary of individual and grouped data. Modifications 
::neQ.essary to time-share multiple student-stations are being debugged. 



Robert J. Seidel 
Project Leader 
February 24, 1970 
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Educational Technology Department 
Bolt Be^ipfek and Newman, Inc. 
50 Moult ^ Street , 
Cambridge, Massachusetts 02138 

Q $ 

-* 

The work of the Educational Technology Department is directed toward under- - 
standing and enchancing learning through appropriate development ano use of 
-computers. Staff members are knowledgeable in many areas of computer science 
.including programming languages', computer time- sharing, man-machine inter- 
action. cx)mputer-.issisted instruction, and cpmputer graphics. We have sub- 
stantiv^ educationgl involvements in many f ield&'including mathematics'^// \ 
languages, meSicine', English, physics,, biology, psychology, f lying^^-^inesr-? 
ing dnd music. We have done work in Educational testing, ccrnxstdlng, manage- |^ 
ment, and administration, as well as instruction itself. 



/ 



Recent projects have included research into^-the use of programming languages 
as a conceptual framework for mathejfiaClcs teaching, the' development^^ of 
associated elementary, secondary, and teacher curriculum materials,- the 
design of a system for clinical training In medical schools (and 'of associated 
medical case material), a survey of computer-assisted Instsuctidn, the r.ro- 
duction of a coraputer-aniipated motion picture, the Engineering' development of 
a teletype-mountable opaque projector for use with' classroom demonstrations, 
the design and construction of a mobile teaching terminal with' sensors and 
effectors, remotely .controlled by a student's computer programs, the develop- 
ment of tomputer-radministered-. Gondj ional tests, the design of new computer 
languages (LOGO, MENTOR, SIMON) for instruction, and the development of a 
tir.e-sharing systeto- for educational management. 

/ ■ • . " ' : _ 

"The activities of the Department encompass .teaching, consulting, and/ 
research. Recent clients include the U.S. Office of Naval Research, the.^- 
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National Science Foundation, the Advanced Research Projects A^ncy, the 
Massachusetts Department of Education, the Anierlcan Can Coijip<my, the 
Medinet Department of General Electric, the General Learning Cornoration, 
* and tne Lexington and Westwood School Systems. 



Wallace Feurzei| 
Director 



I Project CLUE 



December 1970 



lERic 



Volume J Appendix C 



Samples of Instructionai Programs ajid Their Use as Tools for Learning 

Tills ap^pendix provic^ 3- five examples of computer use as a tool for I'^aming* 
Typically the learner is introduced to an information processing procedure 
and its use within the subject bej.ng scudisd. He is invited to use it ixs he 
wishes; sometimes performance goals are specified fc^r him. The emphasis in 
these examples is on the nature of the interaction and the pedagogical content* 

An excerpt of a few pages from many hours of interaction between learner and 
computer cannot adequately represent a set of programs used thoughout a full 
course. The descriptions given here rely on an explanation or the purpose 
and method of the program, a description of typical use, ancf suggestions for 
expanded use of the program. , ^ 

Because it is so difficult to represent materials for regular Instructional 
use in a short space and within the confines of the i^rinted page, the samples 
presented here have been reconstructed from real classroom use. In some 
cases the demonstration shown here came first and was followed by elaboration ' 
into a more substantial package suitable for use in classroom instruction.. 
In the others, records of regular use as a learning tool were adapted for 
presentation in this appendix^to make a point about student initiative^ role 
of the computer, etc* In all cases the transcript of interaction Ijetween 
student and computer was produced by an existing program. . 

The set of samples in this appendix should be expanded to include llarious 
contributors and represent the full scope of computer use as a tool for 
learning. Many projects and organizations were invited to provide samples 
of instructional programs; none responded. , On visits, ctaff collected some 
examples which were promising but'too longhand complex for this appendix. 
Five samples were then adapted from work by the project director to fill 
out the appe^-dix, and selected projects were again reminded of the need for 
examples in Lftc CLUE report. Just before printing time one other sample 
,W£S received, but no in a form suitable for presentation. 

CONTEOTS 

1* Manipulation of social scienr.e data: .Voter opi-nion berore and after the 
196 8^ elect ion ♦ (Political Science) " 2 

2. Expeflence with 'a simulated economy: Integrating theory and policy 

planning. (Economics) ' 6 

3. Experimentation wit^i^an ecological model: Management of 'a natural ^ 

living resource; exploration of models for description and prediction. 
(Natural Resources) 10 

4. -ioessment of written expression: "^ws stories* (Journalism) 15 

5. Execution and test of statistical operations with a real data base: 

Classroom learning research. (Education) 22 

. . i - - \ 
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1. Manipulation of Social Science Data: Voter Opinion 

Before and After the 1968 Election* (Political Science) 



Introduction 



Hiis computer program is presented as a model for capabilities which 
can enlarge the options for supplementary course work in the inductive 
sciences. The program offers the student a research tool to use in 
investigating and interpreting' data as he wishes, a possibility often not 
open to the student because of -the expense and time required to collect and 
organize such material before analysis can begin* The procedure can serve 
the instructor as a teaching aid to stimulate discussion, motivate lh4ividual 
^tudy, or provide a source of factual material for individual or class 
p\:;ojec ts. 

Us^of the program with dciCa on voter opinion before and after the 1968 
national electionHllustrates how the data-processing power of a digital 
computer can be used to seek patterns and relationships otherwise hidden in 
large masses pf factual information^ In this case the data file was derived 
from interviews during the 1968 Election Survey conducted by the University 
of Michigan's Institut^ for Social Research; the same file is widely used 
by professors for political behavior research. 

Ob jectives L - ^ 

The instructional package has three primary ODjectives: 1) To enhance the 
'student's understanding of the tHeory, practice, use and limitations of o 
survey statistics th>5Qugh direct involvement with real data; 2) To encourage 
the development of intellectual abilities used when uncovering and interpreting 
information which i^ effectively "new;" 3) To provide direct contact with' a 
computer^ at a level appropriate to the student* a background ard needs, as a 
worthwhile enrichment experience. 



The progr0m vtHB prepared by Jiark Bamett at the Center for Research on learning 
and Teaching, University of Michigan. 
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Typical Use 

An instructor describes for the students the purposes of the program and 
suggests how chey might best use it to achieve objectives of the course, 
conversation trace on page 4 illustrates the program's operation. 



The 



After signing on, the user identifies himself only if he wishes the 
instructor to be able\ to review his use of the learning aid through records 
s-iored automatically. The program then* lists any announcements by the 
instructor. Foi the remainder of the Session sho\m here, the progrp prod^ices 
a series of tables as requested by the user through keyvords selected from 
a special list naming data variables and tabular analysis. 



Future ; 

Changes in the program are being Jiade constantly, for example to allow: 

f \ 

1) comparisons between responses cf a supplemental sample with those of the 
national sample; 2) additional statistical computatiQns ; 3) automatic i 
monitor of program use; recategorization of original data; and 5) ai)'plication 
to additional date se with similar structure • 



f 



The future for this' approach must lie in adaptations of the procedures and 
datr structures to particular needs of each discipline or teacher, and 
ultimately to the needs and interest of individual JtudentssJ. 
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CONV€RSATION TRAC E; MTS St$S)ON WITH VUTER 



KTS-. (LA05-00 23) 

*_OAtX^ CONCENTRATOR USERS COPY •DCNEWS 

♦ slgnoji sv20 ■ 

#enter/ user password. 
tMnnipi 

#**LAST 'JIGNON WAS: 15:32.«»6 05-02-70 

# USER "SV20" SJGNeo ON AT 15:U1.I*6 ON 05-02-70 
'source sv20:votef' 
#$SET 'ECHO-OFF ^ 

■# EXECUTION BEGINS ^ , 

PLEASE ENT^R your NAME AS INSTRUCTED. y <,f i/oTeJS. 

? user ■ ■ " ■■ V ' 

IN^^tRUCTOR'S ANNOUNCEMENTS ARE PRINT-^D OlfT MERE. — ^ 

. ■ J " 4 ' ' 

ENTIRE OR ^STRATr;-;;;^ ■' :X^TrudTor cav\ y^eMJsn^ i 

? entire i? jlfv^rf of /w^^rtWlW 

VAR. NAME? ^iAti^vds. I 

? think win ' • . . 



fit pr*s9*4f, ^fy "•^fT**^/ 

n^i/i work. Cspwk'l'iy is 



NONE OR SECOND VAR. NAME? 
? none 



VARIABLE " THINK WIN/ 



HUMPHREY - NIXON W)\LLACE ' OTHER REMAINING 

N - 1557 3«»l-21.9t 887-57.0* 79- 5.1% 5- 0.3% 2li5"15'.7t 

NEW, FUHJHER OR SAME? 

? fu/ther. * ■ - . ■ 

NONE OR FILTER VAR. , f NClUDE ,0R RE JEtT^ F I LTER RESPONSES? 

? seen twice reject 3 — — ^ 

VAR. NAME? tuere ^ot re- i*4^ryi9*^ed sH^r 

? think win / i the eiecfjCH. 



NONE OR SECOND VAR. NA.ME? i ' ' 

? ..none -^ • 
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N 



1321 



VARIABLE — THINK WIN/ 
HUMPHREY • NIXON WALLACE OTHER 

291-22. Ot 760-57.5? 59- k .S% 0.1% 



207""15.7t 



NEW, FURTHER OR SAME? 

? ' 

sarne 

VAR. NAME? 
? think win 

NONE OR SECOND VAR. NAME? 
? thot win 







HORIZONTAL 


VARIABLE — 


THINK WIN/ 


J 






VERTICAL 


VARIABLE " 


THOTWN/ * 




N - 1321 


HUMPHREY 


NIXON 


WALLACE 


^"■^ER 


RCMAININ'^ . 


HUMPHREY 


182-..13.8t 


82- 5.2% 


16- 1:2% 


'2- 0.2* 


55- It. 2$ 


N 1 tOH 


87- 6.6% 


529-i»7.6!| 


30- 2.3% 


1- o.xt 


101- 7.6$ 


V^ALLACE 


0- 0.0* 


3- 0V21; 


^ 6- 6.5t 


0- 0.0* 


l»- 0.3$ 


OTHER , . 


0- 0.0$ 


2- 0.2t 


0- 0.0$ 


0- o.ot 


1- 0.1$ 


REMAINING - 


22- 1.75 


kk* 3.3% 


7-0.5$ 


1- 0.1$ 


l»6- 3.5$ 


NEW, FURTHER 


OR SAME? 




* 




1 

1 < * 


? "stop 










I > 



THIS PROGRAM NOW TERMINATES BECAUSE 

OF YOUR RESPONSE. CALL AGAIN I 

STOP '0^' 
#EXECUT30N TE4mi(4ATED '. 
#tSOyRCE •MSOURCE*^' 
#sIgnoff 

#OFF AT 15:U6.50 . 

#ELAPSEO TIME 303.733. SEC; 

#CPU TIME USED . 5. -68 2 SEC. 

#APPROX. coll' OF THIS Rl^ t.gl 
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2. Experience with a Simulated .Economy: Integratijig Thebry and Policy 
Planning, (Economics) 



Introduction 

llie use of a macijo-economic policy game is extremely effective in 
bridging' the wide gap between artificial economic theory and the real problems 
of economic policy. Rather than leaving theo.student with two separate segments 
of understanding and little notion of the interrelationship of theory and 
policy planning, the game is designed to convey to the student an appreciation 
of the real world situation in which the economic policy maker finds himsel?. 
In an environment of uncertainty regarding the future and the linkages between 
his policy tools and his ultimate goals, the student, like the actual policy 
maker, must select a policy mix which will best accomplish those goals. 

The game is not a substitute for, but a supplement to, the other course 
material. The best model for game use is one which is sufficiently complex to 
include the important dynamic characteristics of th^ actual economy and, a^c the 
same time, is simple enough for the instructor to feel that he fully und^stands 
its behavior, 

" —Objectives . , 1 . 

The primary objective of the game is that the student Xefrn to apply his 
economic theory to solve his economic policy problems* He should be faced with 
the same kinds of uncertair'ies, conflicting goals and other economic problems 
that confront* the actual policy maker ir the real world, yet at the same time 

^have the assurance that a consistent -^^dei similar to the ones he has seen 

is 

before is directing the behavior of the §ame economy. 

It is intendea that the student view his game world as th^ policy i.aker 
sees his real one: a set of statistics, ordered by unknown forces, on the^basis 
of which policy decis,ions must be made. He uses the theoretical tools at his 
disposal to analyze the data as best he can, makes an irrevocable decision for 
which he is held accountable^, and learns from his mistakes as his economy 
advances over, time and responds to his actions, 

Robert S* Holbrook, Department of Economics, University of Michigan, 
prepared this model,' with assistance by Mchard KopcRa, and, derived £t £r<im ofS0 
developed by R*. cAttiyeth^ University of Guiifornia at San ^iegOv 

\«* 
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Use 

The model represents a world composed of ten essentially equivalent 
countries, fn ea,ch country, consumers and business firms are assumed to 
regulate their spending behavior according to income, prices, interest rates, 
^tc, while the policy maker has control of taxes, government spending and the 

i ^ • ' ' ' 

money supply. A feature of this model which distinguishes it from other models 
of ^ siiDilaf type is that the ten countries are interrelated through international 
trade and capi4:al flows. 

The students in the class are divided into ten groups (three or four students 
in each) and eacHi group is responsible for policy in one of the countries. 
Their goal is to achieve the best possible degree of full employment, price 
stability, economic growth and balanae of payments equilbrium. To do this 
successfully requires that they understand the workings of their own economy 
and be able to forecas* its behavior. * 

At the beginning of the game the students are provided with a set of 
historical statistics for their economy* These data trace the behavior of 
their econdmy for the preceding foi:r years and pro/ide them with the sort of 
information available to the typical economic policy maker^ Each group 
attempts to analyze the past behavior of *their economy, ■'using the^relevant 
tools from economic theory, and on the basis of such analysis they formulate a 



policy decision which takes the form of changes in government spending, 
taxes and the money supply. 

Any actual decision is implemented at one of the cofaputer terminals on 

* " i. 5 

the campus. Once a student ^roup has accessed the computer and called the 
program, the computer immediately^ asks the group to enter its economy number 
and its policy decisions for the following quarter. The students key in this 
information; 'the computer reprints it In full detail ^nd allows the students 
an opportunity to change their minds or^ correct a mistake. If they signal 
that their decision is correct as printed^ the solution prr-^-^-m utilizes 
their decisions, together with other predetermined lnformat«.uri, to solve for 
the new values of all relevant variables. It 'stores these "new values in a file 
reserved for that particular economy and also prints them out for the students 
at the terminal. • * ' ^ 
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Experience with. the simulation is tied in to real world events in policy 
planning and also economic theory by discussions among students and with the 
instructor. To obtain full value the computer-based exercise is interpreted 
and tested outside the artificial gaming, situation. 

- % 

U 

Future f 

There are a variety of modifications which could be made in such a program 
as well as alternative uses to which the model could be put in the future. 
Stochastic elements could be included in the equations- of the model, thus 
adding ah additional element of uncertainty to policy making and renderin.^ the 
gam« more realistic; The stochastic version of the game might also be used -as 
a source of statistical, or econometric examples. Since the model produces an 
essentially unlimited array of -statistical data, examples of almost all ireal 
world econometric problems can be found. 

4 ' 
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LOHR * GNP ACCOUNTS * . . 

REAL REAL REAL REAL REAL NOM REAL REAL 
QTR GNP C GFI INVCHG G GOV. CCA K L T 

n 665.1 4*55 .7 9U.?. -2.5- 117.2 136'.0 59.1 2118.0 70.U0 96.3 

-R^AL REAL NOM 

YD RE M R l> PCHG P TO • Tl I NV W 

t»85 .5 2U.2 litS.O 7.52 5.11 1.91 1.166 -22 .0 0.190 33 .3 265. 

TYPE 'YES',' IF YOU WANT T0"Vr^7nQTHER QUARTER. . 

.u/oulti lower J t, _ 

INPUT ECONOMY- NAME AND "CHANGES IN VARIABLES GOV'/' F^'^tO, A% Tl. 

lohr Si^vi;^'c9mt cktivi^es mm's ivi *f<irec of Hne fou-r 
-1 03 paHW»r/y mieresf' ^^e (R) g^d ^tke Imltl (P) 

IN' ECONOMY LOHR ^ YOU HAVE AnOSP _ j. 

3.0 TO NOMINAL GOVERNMENT EXPENDITURES . M.M#t%f|C>f oywenT. 

< 5.0 TO THE NOMINAL MONEY SUPPLY 

0.0 TO THE INTERCEPT OF THE NET NOMINAL TAX FUNCTION 
-0.030 TO THE MARGINAL NET TAX PATE 

IF- YOU DETECt1^>JT:RR0B >N'Y0UR INPUT TYPE 'ERROR'- 

LOHR ' • < GNP accounts' , 

REAL REAL REAL REAL REAL NOM REAL ■ REAL 

QTR GNP C GFI INVCHG G GOV , CCA K L T 

22 730.9 .>^15.7 87.3 8.7 119.2 i39.0| 59.3 21.2S.9 70.68 88.6- 

REAL REAL NOM * * • 

YD RE M . R U PCHG -P ' TO Ti 1NV 

S56.1 26.9 --150.0^^^8.10 2^50 0,59 1.168 -22.0 0.160 35.5 317. 




Project CLUE . ' August 1970 



10 



I App C Sample Programs 



3. Experimentation with an Ecological Model: Management of a Natural Living 
Resource; Exploration of Models^ for Description and Prediction* 
(Natural Resources) . / ' 

Introduction " • r 

Learning situations involving models ^ simulation and computation have been 
explored in many areas including, economics, biology, che^nistry, physics, 
sociology, political science and psychology j This sample was prepared for 
a demonstration in resource management and has been used In class inst^ructlon 
ever since* The t^iost interesting pedagogical feature should be thu natural 
and beneficial relation between the use of the computer .as a* training device 
and its use as an aid in scholarly research or on-the'T:job performance. 

*The student who becomes familiar with the us^ and the process of mathematical 
- modeling has acquired a powerful intellectual fool. Students who have used 
' this modeling exercise report quite favorably on Its stimulation of interest 
and promotion of skill ^and understanding, 

Ob;|ective and Procedure . 

The exercise is designed to give a beginning student, practice in managing 

a simulated fish pc^/ulation ^ad in manipulating the underlying ecological 

model. Such a research tool offers students at the introductory level an 

opportunity to model processes or 'In^xrily beyond the reach of their 

analytical tools and patience for tedious computation. 

t * ♦ 

The task for the student, acting the role rf a fishery manajp;er, is to build 
tip and maintain a salmon population in a way which maximi?;es the catch taken 
• by the fishery. He may establish for eacH year the^ minimum catch or' the- 
esdapement. (the number Mlowed to swim up river to' spawn)* Values of catch 
- and escapement for seyeral preceding years are piovided as background data* 

^niis progfaJ was prepared Hy Karl L, Zinn frdm a model and teaching situation 
■ developed' by ^ James T. McFadden, School of ^Natural Resources, University of 
Michigan. . o ' 

^ Prolect GLUE - - . " / '^^ August 1970 ^ 
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After "managing" for a five-year period (barring complete destruction of the 
population while doing so), he is given a summary of fishery success and may 
decide to start over (set time hacjc to 1970) , contir working for another 
five year.s, or stop the game to define what he thl is the best management 
strategy. The "game" for the student is to discover the modeX and work out a 
good strategy for managing the fish population. 

The underlying model for this simpl-e game is an eqi^tibn defining the r,un, 
Che total population available for catch or escape, in terms of . the previous 
year*/, v.^ltie of escapement (number availabJLe for spawning). Management by 
setting the. escapement near the_ level of a parametei: called PEAK is the 
optimum strategy for the Initial model. A proctor or another student can 
reset the paraireters of the equation to change the model and make it a fresh 
e.xercise for those who have not yet seen or analyzed the equation. Presently^ 
the* program permits a studejrtt to list and examine the model only after he has 
described a strategy quite close 'to the optimum one. ' ' ' , 

Description of Typical 'Use . , * 

The learner begins in*, the role of 2 manager a fishery located at the mouth 
cf a river. Usually he air eady"1i^ considerable knowledge of ecology, 
maintenance of populations and sound management techniques, but this is the 
first test of his ability to apply that knowledge. 

i * 

The teaching assistant establishes the ^connection between the term.^nal device 
and the main computer! He requests the file which describes the population 
ipodel and the management .game situation. He has the option of determlniug 
the model and parameters iof the Initial management gaoie before turning the 
terminal over to the student. ^ , ' 

The PIL tiTanslator prefaces each line by an to show ir is ready i^o 
receive instructions or data values. The proctor selects, an alternate^ 
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version of che model (//90) aAd changes the garaineter which determines the 

value of escapement, for a, maximum catch (15,000). All numbers are expressed 

in thousands of fish for user convenience. 

, ,= SET model=90, . " 

= SET peak=ll 

A standard model is us".d for denwnstfations , introductions, and c 'rtain 
practice. The user (proctor or student) may also select other models by 
number (90 - 98, ^ince these^ are^tKe program "p^rts" M which models presently 
are stored), or ask the computer to select one of the available models at 
random. If he types USER, the system queries him for the parainetets of the 
model, or he may type instructions which define his own "part 99." In this 
' way the proctor or teaching assistant may set up special conditions^ for any 
student, or one student may set conditions for another-to play the game. 

- -■■ / 
The proctor tears off the paper (or erases the CRT) to hide tUe crucial 
information about "the underlying model from the player of , the game and types 
"go" to indicate to the TIL translator it should begin the procedure . 









HISTORY • 






YEAR ■ 


CATCH 


ESCAPEMENT 

/ 


1967 


13,169 


A, 830 


1968 ■ , 


12.938 


6.730 ' 


1969 


y 12.083 


14.683 



WHICH MA^GEKENT STRATEGY DO YOU WANT TO ADOPT: 
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This student decides to assure a minfimum catch and indicates his selection of 
that strategy. 



= catch 



YOU MAY CiiA^^GE YOUR STRATEGY AT THE END OF ^NY 5-^EAR PERIOD. IN. 
THOUSANDS OF FISH ENTER YOUR SELECTED CATCH FOR 1970* 
'% 

= 16 . ^ 

CATCH = 16,000 

ESCAPEMENT = 2.900 

ENTER i'OUR SSLECTS& CATCH FOR 1971 

/' 

= 10 . / 

. CATCH =,10,000 ./ ' ^ , 

•ESCAPEMENT = l.OOO' / _ - 

ENTER YOUR SELECTED CATCH FOR 1972 

/ 

/ 

- =-5 ' ■ , / 

NONE ESCAPED: START OVER. ■ 

BY WHICH STRATEGY W^L YOU MANAGE FISHERY! ESCAPEMENT OR CATCH? ' ' 
He learned this lesson /uickly and will next try the more cautious strategy, of 
assuring that a- minimum number escape to spawn. Actually he could have managed 
well enough by setting c^atcK had he studied the history and made some Inferences 
about this population. _ ^ 

^= escape 



1970 ESCAPE = ^, . • • 

The student had to face up to a "simulated" failure for the fishery. He 
goes on to apply now some of the concepts he haH read about and discussed. 

After five years of iiarvestihg (not shown here) he is reminded of fishery 
economics, and invited to break out of the |ame. . 
1974 ESCAPE = * 

= 11 • ; . 

CATCH = 15.000 • , . ° 
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!3r 



FIVE-YEAR SUMMARY " -= " • . 

TOTAL = 67.OQ0 ' ^ 

' DO^YOu\'ISlfTb BEGIN AGAIN, CONTINUE. OR DEFINE OPTIMUM STRATEGY? 

■ \ 
• "continue,, * . \. 

This Student gains another five years of experience whick iX^luded again by 
a summary anJ reminder." This time he 'is ready to discuss the gam 

= define • ' , 

! 

STRATEGY = ' I 

= escape 




.OPTIMUM = 
'=11. ' 



4, 




FOR ESCAPB'LEVEL SET- AT 11; 000 , $ ' ^ 
CATCH SHOULD 4VEPAGE ABOUT 19,000 
19.000 IS THE.' BEST^ ONE CAN DO ON TBE AVERAGE 
YOUR ACTUAL.; PERFORMANCE FOR THE TRIM. SJESSION WAS 
ENTIRE = 150.000 . j \ - 

AVERAGE =15,000 |, • • 

/ 



If the; student :had not prescribed i riasonkble optimum for the strategy of * 
his selection, the program would hkye referred him back ta the game fer further 
practice. Hadle selected the strategy of determining the:,satch in ^dvance of 
the &Mng season, the program, wotld have ^eminde hlSi of the difficulties, of 
this approach. , \ - 

Once the student^ has demonstrated maWery of the management task (within-, ^ ^ 
^hfe loose tdlerances of "this. simple- keyword checking in a short 
dialogue nat shown here) , Re is invtt^ to examine the model Werlying these 



simulations* 



I 



DO YOUrWISH TO SEE THE MOdA UNDERLYING THIS GAME? 

_ - " - ~ ^ " 

= yes . J , 

'90 1 Sm RUN=2*M/flC*ESCApVE/PEAK-MAX'=CES OF' ERROR-4 

' ' 90*. 2 IF RUN<MAX/3 $AND ESCAPE >PEAK, SET RUN=MAX/3 

90,3 IF RUN<0, SET RUN»0. 

MAX = 30 • ' ■ . 

PEAK » 11 ^ ; ■ ■ 
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■ ^OR FURTHER EXPLORATION ' m >1PI)EL YOU PARAMETERP. . 

, TYPE. FOR EXAMPLE, SET .MAX=40. . . . , 

He can' then revise tKe mbd.i in 6.der to play tha game agair, or = more 
"acIicany/Umply display cKe relations and error dis.ri.uUo.s according .0 
the chance: factors included in the model. 



=. FOR 1=1 TO .5, TYPE IN POSH 
. 1.327- 
-2.552 
0.118 ; 
3.195 ^ ■ 
-1.970 



8*RN,0F ERROR - A. 



= FOR ESCAPE = 9 TO 13: 

ESCAPE. RUN CATCH 

9.000 25.091 15.096 

10.000" 28.1.13 13-. 113' 

11.000 32VA56 .21.A56 

12 .-000 29.589 17.589 

13.000 27.282 14;282 



DO PART MODEL 



i 



U 

: 4 

i 




August 1970 



16 



I App C Sample Programs- 




A number of students demonstrate considerable confidence with the computer 
e^s a research tool, modeling rathe ^ complicated processes ordinarily beyond 
the reach of introductory level students.. • ^ - 

Tiie sample described is only an introduction to the approach. "The toodel^ 
given to students in resource management are^much more complicated, even at 
the research frontier of the discipline, Prpjects coptpleted by advanced 
stuc.ents have contributed" to -the research program of the professor using 
models for instructional purposes. . , . ■• 

The work of advanced students j on population models is directed also at 
use in management games for instruction cTf beginning students/ A nunber of 
"natural living resources have been simulated, but operational, economic and, 
poli tidal components of a realistic gtoe have not been developed yet. 

' ' ' ■^^'^^ ■ 

Sampling procedure and statistical routines should be added. by which the 
seident obtains information' about the .population. \ He is given finite resources 
for measurement and control activities, and might ipend them imnecessarily on 
itxces3ively,*ccurate determnatioif of the'popuU^ atone time. The 

management %clsions of /?the student affect not only-the^^ population, but also 
thje attitude and actions of many persons cojcemed about the particular ^ 
natural living resource. For example, in the simple saluon fishery game the 
pp%in responds^Flshe^ry^^oH^^^ ^managej: 
lets it fall as low., ^s 5,000. Economic ani political aspects of the models 
will be expanded. s ' . ' 



X 



Eroject/CLUJE-- 
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Assessment of Writften Expression: News 'Stories (Journa:^ism) 



Introduction- . ' • . 

The fundemental- nature of computers is as appropriate lor manipulation of characters 
used in written expression as; ipr^operations on numbers used i^ mathematics .* Although 
automatei procedures are not aVle to determine what writing is "good" or "interesting." 
Computer programs^ can handle easily such straightforward matters as checking adherence 
to a specific form>f expression, especially one which is^ Ss stylized as a ney/& story. 



n 




Automated techniques cah provide, for the same or less cost, Analysis of more • 
Samples, more quicl|ly, and'*w^th greater consistency than can most teaching 
assistants.' Of course, the machirte should not be considered a replacement for human 
respons'e to written expression. It can serye as a useful intermediate check on 
mechanical factor^ importfSt to a particular exercise, but the machine's interpretation 
can and often should be appealed to the judgment of fellow students or the teaching 
staff. Perhaps the computer is best viewed asi an ally of the student which helps 
Mnr shaiSe his writing in 'the form he .Wishes before t^ing It to Ms peers and teachers 

for comment -on. content. - , * ■ J * f: • 

The designers of"learnlng aids for journalism students in the/ schools and colleges 

can. anticipate the performance aids these students will find in jobs and in hobbies 
^d recreatioa fiv^ years" later. The experience with computer"'process^ng of writing 
^ e'^rcises ofc^lne<S as itudents n be espebiaMy valuable to them as practicing 

jqumalist^ during the iext decade^^w^^^ they encounter the methods of computer 

assistance in editing which are Tiow being, developed;* >.■ '\\ 

O hfective and Meth od 



Students need f requeSt and consistent reaction to their^ writing . Howepiry ; 
instruct(ors teaching iGomposition, journalism,- a technical or. business reporting 
courses are often overburdened by Ifarge classes. . The editorial analysis programs\^ • 
eh^ffle the jpurnallVra; s1:tt3ent^t^^ vap±d 
analysis of Wth the s£yie %^ . - • ' , 

Robert Bishop, Department oi Jgyrnallsm,' Unl^rsity of Michigan, initiated the 
editorial analysis project in July 1969 with the assistance of the Center for 
Research on Learning and Teaching. This note is drawn from^his proposal for . . 
further development. ^ ^ \ 
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* Jxpenaive parsing program^ used in exploration of natural language processing 
are not necessary • Computer procedures developed 'at the XJniverslty of Michigan are 
usexi to ^examine the text of a tepo^t, essay^ or article for inclusion of specific 
information and conformity to a^s^rtleular style. The student does not need tp 
observe any special constraint^ in preparation of his text; the s^dent or a teaching 
assistant need only type tl^ story on a keypunch .or on-line typewriter entry station. 

^ By using variations -of the readability formulas developed by Rudolf Flesch, 
^Robert Gunning and Irving Fang, the program computes the, average length of sentences 
and percentage of polysyllabic words ^hich together give an indication of the level 
of reading difficulty. The x:omputer provides an overall readability rating and dtes 
specific s^entences and paragraphs^ which may need reyision. 

The editorial analysis program ^Isp poinfe out possible violations of journalistic 
canons such as the overuse of artiigjs^^/'adjectivcs^^lithes, or passive verbs as well | 
as failures to co^^rm to the Associated Press styXe In such^matters as punctuation j 
and spelling* / 1 

Description of Typical Use 

Stjudents in a beginninl^ class in journalism firit receive instruction in the 
basics of clear, effective writing. Then th^^are introduced to the computer-assisted 
writing program which will give them^an opportunity to practice their writing skills* 
In a typiSl exerciser each" studert raw information from which to 

write-a ne^s story (for example the pufilic relations release i Attachment I). The 
student keypunches his version^ the story onto punched cards to be processed by 
"the computer in bat^th mode, or, aj: some^^hat greater expense, types his story directly 
into the^cbmputer at an bpr^^ ' 

A computer pript-out g^es the^s^^^ of his story and the comments 

made abput It _hy the editorial: program (Attachments 2-a and Th^ ~ ^ 

analysis of one exercise ptesentiy cosJt§ about §1«25 on the Michigan Temninal Sy|,tem 
(time'-shated IBM 360 dual 67*s). The student also receives from the instructor 5/ 
"model" version of tffe- storyr C^^^ to ccrapare*i7ith his own. / 

The student compietes six^exer^s<^Svj6/hich jequir^^ data supplied iiito 

articles to be checked Jby the computer for content, as well as style, Th"en he is 
aslced to^writ^ subjects of his own choosing. He obtains ^ 

feedback^^^ the com^iter on each of the 12 exercises before going on tp the next one* 

(Bft*^nU&- 7 ^" X V;\r:^" ^ -7 - August 1970 
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^. The editorial ^analysis program checks each of the first six exercises on 
specific subjects for accuracy by comparing spelling of names and presence pf specific 
factl to previously stored files. Completeness and order ^re checked by searching 

for key words and phrases. ' ■ , ' 
^All 12^E£±tles (assigned*subjects and free. choice) are scanned for readability 



and style. 



Future 



_ Several modifications of the- program would make it more responsive to the needs 
^of thl individual student. Because of the expense of comp.ut|r-^tl^_ required, the 
project ha^ not yet attempted to match a student's articlfe a^inst' stored models. 
If this step were computerized/ the .student could receive a copy of the .model story 
nearest his own. organization and style of writing. This would permit more 
flexibility .han comparison to the one model now handed out by the instructor. ^ 
' ; If. a cathode ray tube or other. rapid display device were available, the student 
could edit his article on-line, enter it for |,rocessing, and then review the computer 
responses keyed to the original copy still shown on the screen. He could revise 
and re test hit copy as many times as he wished to, for example, Co improve its. 

readability index . \ _ ' ^. _ 

- All these techniques should lead to professional use' of computers by journalists. 
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Attachment 1 



Journalism 301 




ANN ARBORS- MICH. — The University. of Michig^ Medical School together, 
with the Survey Research Center is doing a study of families with chronically 
ill or handicapped children* Between 200 and 300 carefully selected Michigan 
families will be iut<Hrviewed this summer by University of Michigan interviewers. 

t . , * ^ # 

"We wantfto talk to parents who have been in the diff ieul^ 'position of 
having to deal with recurring' illness or long term disabilities in their 
children. We need their help if this study is "to be meanltigful,**^ sai^^^* 
^Monica Mumenthal, the principle investigator for the study. 

Dr. 31umenthai and her. associates are interested in the physical and mental 
health of parents of _y^^^ cy^tfic 
:^brpsis/ or oj:her.,_chroffii4„ail^^ She said there is very little infonnatlon 

o£ this lcind-a5ra^^ : : / " 

^~ ^v^e ho-pe'^i^^^^^ backed :by a; gr^np^frpm the Natipnal 

jllnstit^tes/^pj^^ majce a-:more 
"^deMm tive _s tate^^ 

when_a :,c6nditip^^ Iti^rmat'ion wpuld;^e tial 

=itt ^atftia^^^ "pQ s s ibly change the 

^^^girtude^^fii^spm ^ 
gBiiiipintKal^s^^v^ 

__ _ The- f^M^ selected in advance 

thi'^ugW ^^^^ ;a£rosjf r:the : s tatel ^hey J.ive Ip 



5diV tjie^s^^ 
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Student's Version of Story 
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A study of famll les with .chronlcilly H 1 or hartdjcapped 
cKtldren !s being -done by. the University of Michigan Medical 
School along with the Survey Research Center. Between 200 
and 300- carefully selected Ml%h>gan families will be^ 
I n te rv lewe cl ; tii 1 s sutwneT by Un J ve r^ y re sea rche r s , 
' "We want to to pa r^^ been In the 

d!ff ic ult pos It Ion of hay In g to deal with recurrln g lllne 
or Ipng "term disabilities In their chl 1 dreo/' said Dr. / " 
Mon lea Blumenthal^ the study's director. * 




( 



It Is hoped 



the University study^ hfelped by mo;^ey 



from the National Institutes of Mental Health, will a I l.bw the 
Investigators to make a clear plcture^of w^at h'apjsens/to 



--- 1 --- • 



families when one of ttie members becomes 



leal I y III . 



The Informatjon would assist In predict I ig family pfobl ems 
1 n SMch cases and "possibly change the act;ltii'de of some . ' ; , 



professional people handl Ing; these situation^," Dr. Blumenthal 



; said. . / ^ - 'f 

The families to be Interviewed have faeln careful-^ly 



selected through schools/ hospitals and cl 
state. The I Ive In almost every major Mtcilgan city 



inlcs across the 
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%/• Attachment 2-^b * 



COMPUTER ANALYSIS . (Journal ! sm 3Q1 Story 6) 




1= -~ « ^ 



Some of your sentences a&^ar to be too long. Check them to 
Check sentences 3^5, ' 



break It Into two or more sentences. J ' 



se It, 



idsrs need to know/ very early !p the story/who Is 



Ml 



to 150 woi 




nK?! J n 2* elements, or may not have recognized some kev 



-i - 

4- 
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Attachment 3 



Model Version for Final Comparison 



Name 



CdXir:se 



Slug 



Section 



1^ 



What happens to a family when chronic illness strikes one of the children? 
Nearly 300 Michigan families with chronically ill or handicapped children 
will be asked that question this summer by^ the -University of Michlgan*s 

tute Zc 



Medical School and "Ins tit 



"ffe want to talk to 



lor Social Research* 



parents who have dealt with recurring illness or long 



terin disabilities -in the:^i"'childfeh,'" said i)r, Monica^ Blumenthal, th# 
principai ihvestigator^^^^^^ : ^ ^ * : 



:fl% invjestl^ato happens to the physical arfd mental ^ 
health (9 families jlaced%i a- chronic iilness such as mental retardation 

or Jcystic J^^^ : - ^ : ^ - _ 

: _ The^^^^ "possihly change^ 

_th¥ XCtitujdfe^^ , " Dr . 

Blmnen^al^aid.^ — : : 

^ ^^'^ iamiites IJeenL^ar^f uli^^^^^ through _schpois , rhospltals , and 

cll^i^: thrpi^^^^ The, study is -financed V National Institutes 

^M^^eiftS^H^^^^ / VSr- - - = -- 



^qrds^ 



Project cum 




si .1970; 



S5 



24 



I App .C Sainj)le Progtrams 



5. Execution and Test of^ Statistical Operations with a' Reel1)ata Bases v Classroom 
Learning jR^searclu (Education) * ^ 



1 

-It 



\ I 



t 



1 



Introduction - . 

. ' It is assumed that sound teaching Ih research methods requires: (1) that 
the stud-int be able to. develop theories involving relationships among variables which 
are defined and for which suitable measures 'have been proposed* (2) that he be able 
to formulate theoreticar hypotheses of a nature which_jiQuia prove crucial to the 
theory; (3) that these theoretical hypotheses betranslited into sta^Tstical 
hypotheses; (4) that he.'lmow the relevant research desigp ajid. ste^isiricai technique^ 
for_ setting up liis e^cpJriment and analy^ng his data; (5) that \)^ babble to plan _ 
an experiment wl'lhin valuable sats of constraints, for example, cost ind time; ajd 
test his h^pothesesVon*'i:e"al data* j * _ _ - . . 

(fen e c rives and- -Procedures > ^ . ^ 

/ The ^computer -program ^^s designed "to provide s^tudents ±x\ e^lucatl^Jl r^dearch 
meaningiii hyp^^^ base. It^fs tbe task 

of the student to analyze \coples of t^^^^^ a^C^vallable, 
genjerate hypotheses as to possitlewrelatlonshlpls among, the va^i&les in the data 
basie /^(see Atta«^ determine whether 

or n^t the-T^yp6_theses wexe^s^^ _'[_ ^ ^ 

- Ihe prp^^^^^^ ar%:iotr designed- to instruct the student in statistical 

computation Vmedures, >ut to" pijo^ the statistlcafl results for the hypotheses 
th€u^^stud^nt/wants to test* This: allows ^^the^stiid'ent to function as an inquiring 

vresearchervv ^: ^ - r ' ' _ . 

7 - is "given to each^user: testln^^^^^^ the statistics Tie 

«choosel:to tfsev-^^ 3^ vd^^ ^s^d^^sm^ qTi^^^^ s tatlsfe|.cs 46r which ^the 

user has passed. (At the present time the program is written to calculate 



\ 



This computer program has be& ^djvelpped-ln the past .two yed^s by Uldls 
^SmU^eteli^at^MealefiiSlchl^^^ 

af^Genter^fe'ri^eie^icB' on I.earnlh^s|,nd Teaching f he l^iversity of Michigan. 
- r|granunin=giass|st^ance: wa^^^^^ Cohen;, Siemjiarston^ and Joliii 3auer. 

4^^^ %i=i5*6rfcf was s"upl)orted iVpArt alg?an^ from- the Air Torce Off ice o£ Scientific 
' Ilesearch (AFOSR-68-1601) . * *■ : . ' ' 

' /Project CLUE 



\ 



.July 1970 



4i 



I App C Sample Programs 



25 





meaU, medians, modes, standard daviacions, 'correlation,coef£ieients, and "t-tests.) ;. 
The student select a .sample- (randpin, sfratiCled; or entire population) . select 
the sxzt Df the-sampjle if it iV^andSm, and determine ti,e statistic the computer is 

to calculate, . .' - , ^ 

i The' students test their hypotheses on a real' data base. .Therefore, the . , 
hypotheses they test are potenjiislly meanlngf ui' and the relationships j;hey d^^scover 
exists witRin the sample chat .was tested.' • ^ 
Description of Typical Use ~ ' • " ^ 

Flisc the instructor discusses the'eiata source and its original^ use, and features 
c2 the program wKich^lll help the student test his own hypotheses. & porl:«b4^ 
comBuier terminal is brought "into the classroom- and operated by an assistant . Woklil 
an-easiet Introduction far' sWents- who have had"prVlous- exper^tence jiving instructions 
to a computer. [ The students formulate hypotheses based inf o|mation given them 
abou;:'the-or±girial data Mle and psychological tests used, and fearn iumjediate^ wBlcH- ' 
ot^hese may $e supported; by itli^/data. r • ; . ^ ■ 

* Tk stu&S^ "then sign U]^ to: liSe the. 

morei^careful defiKion^n^fcesti^ ; 
discussibn «hlch;*esuUs in & generation of interesting hypoth^es than 
- constructed l»y mast iB^vidy^^^^ student present, helps each , 

individual learner cotffijA, his^progress. 



V 




The computer cost ^ec^up per hour was approximately $2.50, about 60<i per 



student* 



Most sAdents^^-easily mastered\he program. After a warm up peri^ in whick ^ 
'the' main concern was^ finding -the cor^iHtn^ys on t go4 questions 

wcte^e^ Jhe inoatSi^^ generated froitt the result? 

of the calculatims t^ey had plann^^rfe'^ar^enTthey entered the terminal room. 
OJ^ tK okglSta^^ they tried to find out why 

by looking at different variables or different samples. 
, Supeestions 'for. Future Use • . ^- ' 

n^^^- ^^psyft*i^ an^opporcunity to do j 

^ethiirt^S «:l«ss m research design, 

work with r4al data. ' Even more important it leads students to use the computer for 
^^8ifc^^tHe^5eourie^^«^^ T^^^^^^ ^ 



July 1920 



IS 



- f 
' i 

* ft." 



•26 



I.App C Sample Programs 



Attachment' I 



I 




I The "da^^a^ilable for analysis were-^xiected in a longitudlrial stfidy of 

creativity, achievemejit, ability, and certain personality factors by Denny, Starks, 

. and Feldhusen. THTfiata' were obtained in jg62 for J3X chlld.r eLin^.semnth and eighth 

& ' ' '. ' ' ' -' ' — _ ' - •. 

' gradBs in a-srakll city school system on the following: the "Coi^equences Test 

• CChristensen,' Merrifield, and Guilford, 1969) which yields measuresW ideational 

fluency and originality, the Afternate Uses Tekr .(Chrrstensen, GuilfordT^rrif iefd, 

and Wilson^ 1969)'^vhlcli yields a measure of spcmtaneoMlyerbal flexibility-Aa 

. creative traits checklist, SCAT^ STEP/and anxiety' (Sarason, et. al., Gen anjy ,i?^a) 

- Foliovmp -data were obt^ained in 1966^ when ' the s t^den±^^ere^ In eleventh and tv/eltth^ 

grades, on tiie following: ^the same divergent thinking tests, the satoe^checklls^ of 

creative ability* The p^cer. noinlnatlons were ol^tain^d T3y-^baving ^1 students 

identify the five :most creative boys a^dnrhe fi^e jaost creative gi^ls in their\ class 

. Clith arid 12tVsrades)t; The_^?cor^ is .ther total ^umber of_J^^es a' sxiudent was 



nominated by his peekrs* A separate set of scojres^was generated when these scores 
were cow^rted^ to a sijc--polTit\tiormalized^xiale^t5:'^^^ Tor abnonn^lity of thie 



aistributioa.^ ^ V :^ * \ ^.^^ , ^ - 

" ^ i$he_ teacher nominations werj^ secured b>^^virig .all, teac identify 5 ^to 2^ 
^v^cb of^' junipr ahd^senlor bo^^ reported for*tea^!her t^td^^ 

itjL. the-same .w^y peer "ratings were ! repbr t^^^ ^ ? _ ; , s^^^ ^ 

CM ^^K^^t?^ I^^de^vei^^om^^^^^^^ cpnforming^creative self view. • 



, Scor0 oil items 
4 



SqoK%^qii^ltems^^hic>^^^^ 



X cl:eatlve ^Tsel ^ view* 

lated_wi|th afcobjectiye mek^ure of ideational fluency^* 

easure of flexibility. 



^^{^^^^^ dfi^^n t^aiidv^ wit^awin 

™ ...... .-.^ _ 

<lffejo>s and -76, g ir^E s for whour complete 1962 
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Attachment II 



/ X 



I. ' State the question you wish to a^k: 



Name 
Date 
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A 



II.* State the^mejbhod you will use to answer your question: 
>A, Sample to be used 




1.^ entire^'^opulation 
- 2 . ' _ random group 

3. stratiJlaed group ' 

^ - - - -r : 

B , ^ CalculatTon to be used 

^1; "ine^ V \ > 

2^ -Tnedian^ _ ^ 

- sltaiSi^^rd 
>^ ♦ ^c^F^pefeaLioii 
^ - t^tiBSti 5 , 



S t^teV^the ucestilts tl^ation 



Strati'fied on _ 



* ; %v i ^at^oiicausicTis^ T^ 



Regarding yolir question? 



Project eCUE^ 
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I App C Sample Program 
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This attachment consists of two' sample interactions between a sCudent and 
"the computer. ■ In the first th^ students intended to determine if teachers, 
when asked to rate the most cr^Sm^dents in their class, probably rate 
something-more Ae'lLQ. They hypothesized that there wouU be a high posltive_^ 
cofrefation between a student's IQ and the. number of -tiifles he was selected "by 
hi teachers' as being cr^tive. As a result of the^ initial -correlation coefficient 
-^f-rsTcusing- a random sample of 45), they wonderei if a student's peers^t^ 
him irt a manner simHaV. to the teacher. They produced^jecond^orre-l^'f^i 
with the sam^^ample, Ob earning this time a^^e^ffC^i^it of .41. It is ^ow the 
responstbil-,ty o£ the st»rd^s"T^nterpret, the resulcs^ of his investigation. 

Th^ second i^nteractionT shows students testings difference between IQ scores 
for^oy^ and girls in - theflotal po #u]^tiqn avaiR^ "me two samples (boys and 
■girjs) iere ;selected and a t-test was^perfprmed to; test 'for a significant 
difference. /Ag^in tte Students in ter^ further confiT^ation 

and new . ideas are/ of tain^ ' 



/> 



4 
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Attachment IV 



I App C Sample Programs 



STATTSTTCS 

^EXECUTION BEGlflG 
STATE AN nrPOTHESlS 



GIHL'S IQ SCOHKS DTp'ER- STGinFICANTLY FRO^-^' BOY'S TO SCOFFS 



- i 
/I 

- s ■ 



SELECT A .3AKPLE (SL-I TE 1) 



STRATIFIF!) 
SPECIFY YOUR FIRST 




GROL'E 



|.'ACES m fE^'ALES? 
F ^4 ALES 

F UJ^TH5R^^^TR."T IT TC AT I^N ? 




NO . - -~ - 



- ^ \ - " - _ - 



^T?i5^ Ti^Ej^A:I^El^^N:D GRAfeLEV&L OJF A TEST 
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I App C Sample Programs 



Attachment IV 

FOR THE SECOND Tl^E (THIS TEST)... 
BELECT A SAN'PLE (SLl CE 1) 

STRATTFTEO 

SPECIFY YOUR FIRST SUBGROUP 



(STUDENT '^UST nO'l S'PFCIVY 

Z Gim's sconvs wtll 

4. COMPAHEJ)) ' . ■ 



SEX 

t/AL€S OR FEMAL-ES? 



FURTHER STRATI F I CATlOrN? 



NO 

N= 116 



TOTAL NmiBER OF |C»I5> 



EMTER THE make' AND GRADE- 



-.L OP A,1 



^; & ^^^^AtARiii^cES samples? 



' " ^ ^ / \^ . J:^ - ^ ^ (^STUnEDT 'iVST WW USE TABLE 

s;:^^; ^y:::^^% ^/v _ ; c^^r i::^- , r5 siGNiP, ) 
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VOLUME 1 .\PPENDIX D 



.Ds5MlN OF COMPUTER USE DEFINED FOR PROJECT CLUE 



CONTENTS 



A Problem /of Names' 



(Thej origins and connotations of various acrofiyms, are compared 
-Pro jfect CLUE ^taff have avoided use of any simple labels for the 
entilre field of instructional use of ^computers.) 



Modes of 



Computer Use 



CThfciiSual sfpproach to characterizing variety of uses o£ 
compters in , the instructio process is described; classifications 
of ten writers are co^opared^in a summary table; modes are ^grouped 
into four areas'^ln^—v^ - i 1 * ^ - S 



Manas^ment^^^^^ 

;Ere^^4tiQn^;a^^ ^ 

bimen&lon^^^f Use ^ - i^^.. _ 

^ (i^Ja];j;ern3tiv 
acg^^e^ti^^ 

^\^^^/S^S^ra3^pM^o system 

^^Sgi^JSS^^^ 1315 Hill StreeF"^^-"" " ; 
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I App D Domain 

Project CLt;L has considered uses of the computer and iTtformation processing^ 
sciences to\assist with instruction and -learning in education and with the 
development'W learning materaali . and related inforraatioti-r6Sourc.es. >" > 

The broad context of discussion should be (automatic) information processing 
^stems in eJucatio,»4 some, of the more specific references are computer- . 
■assisted ins«uctlon, • computer-assisted Instruction management . information 
storage and retrieval, computeS-gWnerated dnstructdonai mat^als, and 
, discipline-relevant aids trskiiy practice and scholarly «o.i. by U 

Administrative uses of the computer .for^record keeping, jchejjuling. reso^ce 
allocation, ^and data processmg^^ere not^^luded iI^ survey and. review^' 
-^tivicies^nd^ar^^efttlon^^ ^tt^glvjes^ administrative 

' ^^sL aSe^KSSir^i©^^ ^ 
« -St as Sir^titi &i^^ ; 
> >^coS,ersaSpi^ut&fe'? usSa . 



^lnterae£537e^ses 



V _ 




|Q^S^)Sre:ift3rt.g;^^ , 

IS^^pSa^^^iaaK^^ 

fi^ScileS<Mii^^Mle^iM^ 

tbe machine 

using ^a card reatier and printer, located for his convenience. 7^ • 



ERJC^ 
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A Problem of Names . ' , ' 
— — r * J . - 

on. ' - * ^ ^ 

Hie uses^of the computer as an instructional aid have been represented a 

number of acronyms including XAr,CBI, £mI,..GAL, CAE^ and many others. Some' 

persoifs associate these labels* with particular, uses of computers, university 

projeckts, or compter' manufacturers ,y As a result any single^ a'cronym can 

'mean different things to dtfferent/. readers. ' 



\ 



"Gomputer^asslsted" or ^'computer-aidect^nstruction*' (CAI), used by IBM 
. research .staff in early writing aVout l^^^ is now the most 

commonly used acronym. SysteffiDevelppment Co^^ the label 

^ ; "computer-based .instruction^^ Stanford * 

University and HCA. "Computer-rassisted learninjg'': andf "cx^mputer-augmented 



learnl,^^^^ bfe the vari^ty^of uses 



of the computer in;^uca:tid^^ would be 

cinfused^i^ith^^^^ 

^If v5_oip^^^ instruction "by^ 




perfbgians^^^^ th^ ^labelv^^ed 'is_ 

l^?^9]pP«^^^'-»anaged instruction" (CMI), ^ thU-s use, the student does not^ 3" 
■ receive instruction directly from the computer, but only information about 
-^g^^^ scores 
^ t^^ ^ajjg 

T /^St^fingl^^^ ecisi 

^ Staff at Stanford Research Institute coined /the phrase ^augmentation of . 
' human intelligence" (AHI) for innovative wo^tk in comp«tir-based sysfems which 
,aid the user in'vairious tasks includinig education.^ A fe* itt6tructioh-oriented 




i;^n^is^gl^eh^ t^^^ for interpretation^^ 



^ tR§jg^^the_^^M to be 



/ 
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viewed as 'an aid to and an extension of the intellectual abilities of the 
,leariier rather fchan as a drillmaster or menior supplanting his self -discipline, 
mo tivatioh 'or integrity. .AHL is not widely used as an acronym in*the*area of 
instructional use of computers^ ^ut ^Tie connotation seems to be increasing^ in 
favor. t . ' \ ^' ■ t * . ■ • 



gecause \grpnyms tend to .become -associated with one manufacturer, computer- 
• system, or research^ and ^development project^ tbey do not adequately label the 
. entire field; Por some obseryer s the CMP $.^eX implies aiuthor control to the 
>exclusion^ai the 1^ initiative and direction of 

the computf^ 'pro^ebj^ ^ 

Aufhor^cqjl: jPr^^ H3^E 4^ aii^ 



whjshS the C^^ ^ppeatff ife^h^C^ ^fj^Xs -59_*^ definition 

of I ^gfi te^^^ , 
phrases ia%e 

f 1^ exampf ev 'icpi^utij^b^^^ tfe "co^ut^^ le^frnlng 

,fc^o^?v^^5r^:simpl^^^ ^^h€^j^%^^ the^ 

- i^a^ingcp^^^ tH| 

-^tetf^iont^^^p^^^ ^^gaMM^fe^of ^)^^^ juare^as zgg^^^ J:e8 1 ing 

fCBL^^^ii^^^^^^ JCLtjorf^Gl^jS^ confusion 



V 



^Ifc^esgo^Eo^ute^^^^ 

S^n3^^1£«si^ji^ 

-^ife^^^^^Vip^^ the^ 
^dlff^re^^^ 

ha^f£j^^arj3^a is not 



V- 



^^jteade^a^l^ 
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Other uses of information proue^sin^ , A number of other .potentially interesting ' 
categories are listed but without elaboration since they are* not centra %to - ^ 
this d^rcu^^t^lciu Is-evertiiel ess, computer users give considornfilo nltonthin 
to the educational, implications' of computers in aUmlni^lration {account iii^t^ 
scheduling, pjarning^, etc,)> research (institutional, sociological, psychological, 
l^sXructiona#^^tc.), and^ to the relation of ins tru<;tion po various applied s^^* 
uses, it,c last aiea is especially important because of needs, for pxje--service 
training in scieime, technology, management, banking, production-^Vetalling, 
e&. * I ^ ^ ' ^ \ 

■ : ' ^ : > ■ V ^ 7 ' • 

This concep t^a of the variety of _^modes of computer use, arran^ied to _ / ^ 

Incorporate the classxf ication schemes by othex|-iuthora^ may 'bi useful only to 
promote- awareness, of tegms whic^^ of. tfils field. 

In f^et, _it :jiay d^stM^^ of scrvlhg^^^ and, 

secondarily^ ^ Ins ti txons 

_//- 



ppi^gxiter use ^e^uirje ^bme consldetation 



Analysis agd xeconroendation xegar} 

pf _ t1fe_ rfi^ehs^ #lcft^gight jJ^%5^^;^t%|^^^ f or ^classif ication 

.ai^^he^ afctu£^^ learners. A 



tentatlyje^^et 



d^ensibnsKl^^ 

J)im<afetbnsSiM I ./ 

to^ the vard 

^^gO^jES^^ ep^sc^^ This ^s^no t 

Ml^^^X^^ i^^ only as 

illustrations of, what might be dca^i It should/be muph more Interesting to 



rious schemes 



^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 



ye hjplpiul^ than the 
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Project CLUE staff have tried to identify several dimensions of , use and their 
relations to each other* The tentative conceptioa^^iyen here- Is. not 
exhaustive or theoretically coniprehensive. , " v 



Progra^i Control . Computer-based lessons differ in the-coijtrol the i^riter has 
over t^e^ student *s course 'o^ study • At one extreme the student can only 
follow|the program; typicallyhe finds himself more restricted working at a 
computer terminal than he would h.e with a textbook or set of ^rill exercises. 
That is, the: Writer of a tutorial exeErcise flas"" not provided tfte cpaqputer 
li^ true ti^ris which would permits the student to . look back, review or skip ahead 

as he does with printed materials ' ^ ^ ^ v \ - . 

_ j^-i i_ _ ^ _ - ' =1- - -£^" - =_ ^ - r _ _ ^ - y 

G^ntrq is deslral^^ ^used . 



^3^fegQit3^^<^ sk^^li^-al^e or other ! 

dlstra^MpW^^^^^ an ^^ygi\t^ge^ii|n^^^^^ dfesigndr : Is. 

IilsV taate^^^^^ to:: knpw exacit^yr ^^hat eacfc tri^i a^^^ seen and 



At jEKe^^pther e^ alisos t^J/cp^let^^^ cb^uter 

^i£^g§^affiii^^3^^^5^f^^ ttfe; ^ 

J^^1^^i^^^^f^^^jg|go5^J^^^^^^3^ 

^^^:^^^^^i^|St^^^g^^ 
j^^tpi^^J^si^^:^^ 




osis^^U gfeWclfeiyfetonv j Ago^^ dimerfslon of cdfflputgg^^ the 




ly^y^^^^^^^^^^t^B At 
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presents simple linear programs "^fir VKa^^t^^^^ exercises without paying any" 
attention to the student's probl^li solutions or to his response to questions. 
At this "zi^ro leveT' there is no Intrerpretaaon oi; prescriptive feedback 
determinediby the author's procedure to be display^^ to the student or saved 
for the'^uture use. by the prp-grara procedure itself, 

_ i <y - _ ~ _ , * 

In typical tutorial uses the computer prograin processes student responses ^ . 
and tf^ies to act upon th^W during the ±n^truction sequence? by selecting, for 
the stpudent apprt)priate remedial or new mater ialsr. /Such a' progran: could also 
give ±iit%rpretatloxi of response Measures directly to the stfiUent^iefgC^ 
telling him j^hy he^^^^^ more practice with? or without allowing him control 
oyer^^aturj^ actipiU^/ 



. interpretation bf student actions, e^g.-, presentation of the correct form 

^i^^^^l^e^^ea^^ solution 

^^l^^^^^^^:^ the 



_ _ ^^^^^^^^§^^^^^^Sni^^^^^<y-^Q^ has , _ 

tetp^^n^af^^^^i^^^^^^ other 
^rd^^^l^grS|r^;^^^i^ 



student why or .prSwBajfc SSfil^^^^ being fed 
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prascription which passes along 4a ^ach student only as muck as praisQtes 
lesruing and favorable attitude, and avoids the distractions_.of too much 
information or irrelevant i'nems* . * ^ \: 



f 



i S 



Variety of functions available to users . The ^scope of opportunitial for* a 
user (whether student or author) in an instructional system varies from the 
limited posslbdELitles of a ^completely pxe-programmed exercise ^to \ , 
the full capabilities of a richlyrequipged and general-purpose system, Ihe_ 
systems dedicated to '*drill and practice**" ^re examples _o£^ liffiite4 variety of 
_ functions available to the userr authors as^^mble^^^ ^ 
presentatiojl Recording 50.^ preset {^f|rate^J^f, J^^^^^^ tKe question Item,: for a 
timej, then show its cor resp^ding iansw^^ - 
^ Jilt ^sequence and wlttiii^.tKe inteiac^tiye^^f^"!^ thelpyst^m, Perbaps 1 

j author SYjna^^^^^^^^^^ ^ 



Actila^^ in _ \ 

5^^^ jseSse "p^px^o^r^ Jbe worthwhile. 

foiTytherJns.^^^^ may 

iSt^lffde^^ and .thje 

4^£fer 3tna|j;v^^^ a: co^l±cat^|-i^^^ seleqtfamo^g Uth^^^^ individual 

^:as|^ ujiin^^ ^char^gter^^ 




^^|hMgfiMs^^ they ^ 

l^jcJiS^iJs^a^^^ the conteflt 

tj ter4l?%£^gg^Lfa;g; P^581?^i58 ^SPg solving 

It gJ^M^{a?^li^$S^St^ ^^fii or 
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Type of ttittrtaction^ As a dimension underlying coiaputer^ use^ ^nc^raction^' 

refers to a coiaputer operation in whiiih particular atoention is given to the 

xonjtinuing exchange becweetv^^ser and prograta* Typic^.4y tl^^ user types 

some instructions, the computer types Back partial Msults, the user modifies;- 
* ■ V - ' - ' 

, hid ariglnal statement or continues with new Itrntruetlonj and the computer ^ 
- -- " " - ^ - 

responds agsin, etc* "Interaction** refers not only to the speed or rate of 

exchange Letween user and machine^ but also t*3 the extent of dependency of 

computer reply on tiser Input/and v^iqe versa, - 

^'Interactive" has been used ^s a labeX for certain types of progranSiing' 
languages jj3l4 problem'-oHente^^^^ have;speclil features to 

facjllltate . "convert tlon?*^ be tween%se% lesson (or:^ system) 

^designer ^kn^ws t^e student (or Jp the^^er|. viljjbe there to answer questions _ 
when, tbe.^procedure c^ jiot ri^itiat^^^^^ user ^^>^ 

Interrupt tfce prgced^ i^ltig^qutj^t^^^ th^ Js ^ej^e^sar^r^, 

jSe; jdei^n^ 

^Ifi^inde^^t^Si^^ ^ _ ^ 

Interactlori^ "dyniMics," : e^^ parameters §M 

^ guUiltance^^^ tq^^^^^ cpntenfe^r student^ 

-jres^ti:^^^^ iipt antici^aH^ th^ 

;^i%s/3[n;C<^ advance, ; 

dei^ery- cqul^ Save * 

device t 4#e*/J^^^^i^^^^ :^x<%%pcXot or 



- IU)3:e lof-^ the coiiai>ute^ forctnef jtoctlvjj^^ see the 

Jn^^^^c^l^^^^fo he may 

ris^3^!^a^\^[^es^tm^^^^ icq^SSt jiy^ If the^ 



^1 
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student does see ttie Computer as a servant^^atng his bidding, and a vStudy 
aid. doing what he asWs, he _ may giVe j:he results of processing 3K>re attention 
and thereby better use the devi'ce to further his learning objectives. 



The teacher, on th& other hand ^ tnay see the^oiaputer^yste© as a procto^r ot 
required exercises/ andL a validator of performance in testing ^itWtibns, o'fi 
course,^ the individual students still mustr-he proctored by soae teacher or 
student aide if tlie system is to protect' against one student sitting, in for 
another, or usltig inappropriate aids whateverTtind (booka/, notes, another 
computer, etc*); ^orieday iiiachines^Sy^autqaijfically check, fingerprints or ' 
"voieeprlnts,"Wand various written and^p ro^dur a^ ai dg ^ll jbe assumed 
available as part of the performance task* 



Human attitudes towar/i tne machtoe cannot as easy to 

deterpine as /perhaps the degree of program^ontroi-^^ dlaignosis 
and prescription. Ihe rol^ of the io^Sitei^^iit be 

dif^ferent perspective^ tlvere are; pe^ view of 

the computer "wlOJr interact: in^ varying degrees with other^^^^ 



-Naturalnep" of the commnication between^ learne^ systsa> At one end of 



k^nsJojh oT natural to\ Jbma^^ ia 
progratoB^i^;^o^5ithat the student may r^ ^ 
^jiirgl 4^ him, and lit tle^d^fyp^^^^ be 
learned to use lt» Hot language^-orije^ . ist be 

capable of perlorming corf Vicated texttwil |ma§^£^p border to coiTduct^a - 
dialogue Jwlth the IS tudeni.. The coi^uter's JKflity-toTpro^Ms natuibal language, 
and subsequently to diagnose *nd prescribe on th^aals of its^^^ by 
th^ slSdfiat without^ £«iy constr'a|nts7^P>roaches 

Intelligihnce*' and presently is v>2ry much in a tlieoretical «^ * 



stage of 



development. 
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At the other extrelne the user must learn how to giv« messages to ^e system, 
to-recogniie what has been interpreted successfully, and when to caH on 
tiuman aid it tli^ system does not respond understandably. Learning computer 
conventions is no hardsiJip for 'topics «of study in which the conventions of 

\computet use are consistent with the objectives of instruction, ' Formality of 

\ ft % ** 

communication i^ desirable in the sciences and engxne^ering where the computer 
and its programming ^conventions provide appropriate "comstraints on 
theorizing and model -buildipg, - / ' 

Summary of Trends ^ . . 

These six dimensions can be viewed as definingf^ space or domain of^^ coinputer 
use, and the modes usuallySttentioned as siaple^ categories (drill, tutorial,^ 
dialogue, ;socratic,_si&uIation, learnBr-ff^^ ar«^re appropriately 

described as filling somC part of this ^dofflaiti* This conceptuAllzatlon has 
been used by Project CLUE In a tentative wiy to.estaWlsh iwwftg users a 
^broader perspective/on computer use, aiid ^to^lopen up new possibllitiejs for 
cbmputerservice to learners*;^ ^ 

A major trend In design Kjf cwttj^uter-'b'ased exe is a shifty from program 

to-lea^^i^ coutTol/ T^^^ putting ^.ess energy itito 

a careful diagnosis and -pr es^rip tion accti^ by spac V automated 

instructional strategy and more effort into providng information f rom vhlch 
* the ^student ban derive his owf* diagnpsis -and into making available alternati^^e 
interpretations and guidance from which the student can assecflble his specific 

' * * y^ • 

pxescriptlons, * 

Moet systems and lesson designers are providing an^dliipreasing variety of 
functions for the user of the learning system. Mor^ attention is being 
given^to iiiceraotloni not .siii^l^^^^ a reply can be made to some 



questibnt Vutrthe^^aetaal resp^ to the particular 



/■ 



, P^aft August 1970 
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input. This means chat machine responses are increasingly dependent upon the 
commands and questions 'and answers typed by the student, and, the lessons 
are designed in a war-that the-student is more likely to respond to information 
provided by the computer. ' ■ 

A very important trend concerns the role of , the'-'machlne from the perspecti.e . 
of the individual using it. ^ The teacher Is, new more likply to .«e computer- 
managed instruction as an aid Ao human ma:nagement . than as a replacement for it. 
Probably much mor*. important, learners find the machine more auitable-as an • 
aid to learning than as a drill master. ' • 

Nataralness of communication between learner Md system ia being- impcpYed -. 
daylby day. Computer-based learning exereiae. are achieving dncr^sed "relevance 
for the -subject being studied,' and the no»wiclatura and conventions that have 
to be learned to use the_sy8tem: tend to be eisentlal to the-it% of the 
topics (apart f rom the «qu±reiMnta of the ico^utet aa^ a presentation). 
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This- glossary is 'for the novice reader. Jargon has been avoided to # 
^extent possible. Some definitions m'ay be technically incomplete but i 
*hopeftflly none are erroneous or misleading. ^ , . ^ \ , 

Terms are defined from an educational orientation; the same words are' " 
used throughout the information sciences, occasionally With ot»^'r j 
conndtations. Most of the. definitions include a sentence usin^ .he / 
word.or phrase ;o clarify the meaning. These sentences sometimes egress 

opinion r-athei; than^fact. • " / ' 

••• ' • - • L^-L^f ' / . 

Longer glossaries with complete technical definitions are availablei Two 
rather of ficial ones are. listed 'below. • Altho.^igh not concerned exclusively 
with educational uses of computers, they vpr^vide standard definitions -of 
* ^-..„^ — „Ma ■f'n nnmnnHno and Information orocesslng. 



many terms- used in computing and information processing. 

USA Standard Volabularv for Inform atibn Processing. New Yorl^: 
American StanaardsvSAs^^^^^ , 



1 



Automatic Bkt A Pr^essit^ ^"^^"^ 

SKorter Itossariesv ^fi^en;vit^^ available from 

tnost computer tt.;^^^^ and some professional societies- | 
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access time Time required for the central processor ,of a computer to obtain 
inforLtion from a sLrage device (r^ad-time). or to put information away in 
s^ora^ (write-time). An educational computer system serving many users 
Hm^Uanelusly needs a storage device with short access time from which to 
reeall frequently used information. ^ . 

acoustic coupler A d^ce used to connect a user terminal 'to/" -ordinary " > 
- tel^ne for the purpose of ^ransferrJ^g information over telephone line^ 

audible signal go the con5)uteT. A "data set" (modem) is wired 
Sre^ly bitween SSphone and terminal device", instead of coupled by sound 
witr^Vcro^hoL not affected by room noise but is more 

expensive than most acoustic couplers, - 

■ AHI (Augmentation of Human Intellect) -Computer techniques for retriev^a. 

.^arranging and manipulating information, usually text, sometimes diagrams 
or 'anvthint that helps one ej^Tge -in Intellectual activity; computer extension 
of Wan alilities to- accomffish instructional research, compositions or 
oyercreative work. AHI As th^^ name of a research and development program 
at Stanford Research Institute. 

^^^^ _ : - _ ^/^ 

aWi|hm-'&'unambig^^^^^ procedure for solving 

a problem , ^to px^p^^agplfeii.^ algorithm always produces a soluUon 
to the problem. (Contrast with "heuristic. ) 



:^nao.Ufeaffiifeei^ C^tfe analog): ^ /device ^ich uses ^voltages fgce^ fluid 
^ ^oia^:jEr"^t^r c oDtlnuougy^ariablfei>^^ represt^ 
^m^ixrmcmm^.nt xs^convenlent tbr solving differential equations, 
/^imiffih^us :equ^tip^^^ ^Contr apt with digital 

-tompnter.'')^^^ ' ^ ^ ' * . 

ASCII (American* Seandard: Code: for Infoimtiqn Interchange, often pronounced 
i%)^SSl.hed by^fte ^^ ^"l^ ^5^"^^^" ^ 

for Aresetltatic^s^^num^ 



- . #- - 



>11 user' terminals today should use AS&II ccSde. 
author-^bntr^lSd^utoiagrm^^ (See "tutorJ^l mode.") • 

b andwidth ^^Tue dif&ence,: expressed inVcycles -j^ ^^^'^J^St^^f ^f^^^"^'' 
and «esf frequencies io£ ^m4^ot^^^ "^"^ ^^^^"^^ 

amomt W quaitt^ of i^^^ pjissed p^r second. Bandwidth 

SLSedWc^:^^ bits i«f second : (CPS ^ kilocycles per second (KG) 

S SgKyie^pel^secohd (MC^ 'lloLation 
hLS^Iz ana&Hi):/::^ac«.%a^ carry^lnformation 
fast enougfr for 5:af>id display^ at; a remote site. 
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-^jobs . are submitted m, batches, 
"time-sharing.") ' - A XlO baud channer ' 

^.^^^^^^^ rer/:no-o ... .... _^ 



(See "core.") ' ■ /rtielf^Ta-. " • ..nt- the 

smallest eXement of binary v ^/ , , , 

^evlc^;" nnd-byte.)-- - ^ ^ - 



----?«-=rtM&4^^^^^^^^ " -^f teSit of ah individual 

. of data, or time of of^"" . ^ user may be collected xu 

of his terminal <ievice ana u 

cer^m^m^m-^^^m^ : ; * -^eharCer. for 

: i«vcomputers;v.*4????V^^^ . ^ - . 

: » 
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CAL (Computer-assisted learp.ing) Similar to CAI and CAE with connotation 
^greater atteatiorr to or service for individual learners. Also tne name of 
an. on-line computadion language developed at the University f^^^^^l^^ .^^^^^ 
Berkeley and a coursewriting language developed at t^ University of .California 

at Irvine. ' ^ ' . - ^ - 

CBI- (Computer-based instruction) Similar to CAI and^CAL but this acronym is 
used less frequently. 

CBL (Computer-based learning) Connotation of greater attention to or service 
f^ individual learners j less frequently used than CBX. 

^channel A path for electrical transmis^sion between two or more points. Also 
called av circuit, -line, link or path. . 

■ charactQjr A digit.' letter or other symbol, usually requiring six to eight ^ 
^ bits for representatipjn ift digital computers. _ , 

CMI (Computer-managed Icstoftrct^^^^ 

fm^ctixjh-o^ thg'computer.l^^torarssi^^^^ , . 

IbeV^^tual^lhstrucfcional^cti^^ through CMI ma^ or may not , 

inWive iKe: c6%p^^^^ 

-compiler ComputS frogriCfpr-tt^^^^ 
P5^^ar-uset^iang55|¥^^ -^^^^ 
(i.e., binary numbers signifying basic operations such as add, compare, store 
and^jumpj'fbr iepeat^^^ "interpreter. ) 



comput^bn^mdde^ CSiarStion. ^hf oIlatTori^^^^^^ processing as 

"direct access" to knov^ledge and. procedures for handling knowledge. 

/eoimee^^^^^la^eP^^o^^ ^ the Qomputer 

^^■m^^^ls#mVcHflg^=^Som^^commer^^^^ 
for toMect-tdle cegailliss^ol^corapu^^^ resources («. g.^ central processor 
time and storage) actually used. (Contrast with "executiort time. ) 

core^'fexapld^Ss^^^^ "^f 
^^^mSll ri^gs:.mM-^Kma%n^M^^ f '^^^ 

*^statei^5t-px>liri^^tlSn.-^^^^ kept in 
core'^&ng^eSecutlSn^^^ ""^^ °^ 

obtaining it repeatedly from a sltusr speed memory device.^ 

course • Used rather loosely within ua projects to mean any instructional * 
ii^ce or compuVer-based learning exercise. Many CAI systems have only a 
few^ demonstration courses operating successfully. • 
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CPU (CenSal ProcesXmg Unit) The central sectfo. or a^co^pute. l-cludlng 
"ffie control and arithmetic units 

Sfor3pref;nd'5soSlSaM°Ug capaMIUy. . Other devices caa serve 
: the same function. (See also "plasma panel. ) , j 

curs.. A point or llne^of lightm^played on.he ca^^ ' 
-Ehe-^ntrol of either the- user or the ^^'"Pf "^^°.>"^i^"^^,3,^ • 
the next display or^editing 2Peration_ is to occur. 
of providing the user with a capability to point (See also xign p 

"RAND tablet.") ■ ' . ' >- 

^ . , ^ ^4 anvl re thieves blocks 'of information on strips 

data ceH, A device stores J^.^^^, 3trips from a storage cell 

of magnetic ta^e by automaticalg^trans^^^^^^ than disk storage, but 

to ^a reader -andaack. data cell operates _ , "diskpack" and 

is less-expensive E^r bit and .has^la^^^^ (See also disKp . 

. - - T L 4 f^CSlTr the-daVa-sets manufactured and suppled by the 
i^lig.^a's&i^aS^or^ ^ the^eguxar 

. , .telephone network (DATA-PHONE Service) . ' 



lit 



data- set 
An 

rLm'noisrthan' the direct-wired data set; 



decision abo-at the perfotcance of the oxa::lnee. , 



^a^^fes|on^^^^^ 
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dial- up service Ordinary acce-ss via.telepKone to other telephone instruments 
and the -compute r that- may he connected to them. Dial-up service is paxd 
for by recorded minutes of use. (Contrast with tie line. ) ■ 

di^it& comput e A device which W digits to ^''P^"^ ""'"^"^^^"f.'P"^'^^,, 
sy mbols m cal culations and other. iafol^atlon processxn|. A digital .computer 
is the most cojranon type of automatic data^ processor. (Contrast with 
• "analog computer.") . . ^ . ^ : . ' 

diskuack (also disc) Attack of .disk-like plates coated^with magnetic u.aterial 
for the s tora^ of informationj bits can .he stored upon and read, from the 
surface whilAthe pacfe revolves at high speeds, somewhat x Ike a stack of 
phoflograph records combinea; with the -record-playhack capability of /a tape 
recorder. (S*Valso ''drum" and "data cell.'') ' , 

dtsDlav . and^^mpo^ition- modex - Computer use in whi ch > cbmposivion is .constructed,, 
perhaps a gr^Shlc;display.; V I art or, ^ngineertng^or , |ext ior a newspaper 
story orE^tMikSin-a^writ^^ and.^ompos^tlon, . 

typiJaliylisWen^lvs afftdm ^"'^ 
convenience in constructing grAfihic displays or processing language text . 

documentaci^ ^Des<adLpt^^ 

pro(fess^d^h e^4nMr^jase^ '^cct^ program documentation 

often determines whether that program will be used by others. ^ 

down-time Time during which a computer is not available fo^ operation, usually^ 
beSi55C^=tCaaure:iti;^^^^^ "O"'^ p^r.day, — 

especially when it comes ^unexpectedly, is not tolerable for serious, 
educational uses of a computer system. • 

^arSfeSS ^iiSSgri^ straightforward ^'f^^i^^^J 

: tyP^lIi^ afelfigiieSt^ongias^^^ jinswers. The jrlll mode 

.-uJiaTlpliitndi^on^aUMs 6#^^^^ ^° 
jp^ei^^b^Sfrlll^M^ pre^feLtation , or possibiy^ 

generated from stylized forms. .! . ' 




drill-and-practice-mode y'See "drill mode^' and '^/ractice mode." • 

drum A cylindrical drum coated wik magnetic Material for storage of 
l^^f^rmation.. Bits can be stored upon and read from surface while it revolves 
at high speeds. The rate of data transfer from a drum to GPUj^entral 
processing unit) is ordinarily more rapid than a similar trdisf er from disc 
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duplex / In communications, ra£ers tt simultaneous indipendent / 
transmission in both directions (sometimes referred to as "JEull duplex**)* f 
In duplex operation the usei is'able* to send new instructigns to the computer 
at the same time his terminal device is printing tlSk results from the la^t 
request, (Contrast with '^halfTrduplex.") * * \ 

exectition tim e Hlme during which the computer is actively processing a user*s 
job ^roughly equivalent to "ci)nnect-time" for strictly batch processing, put not 
for "multiprocessing (Wlieh th4' computer/Is executing more than one job at ^a 
time), Esc ecutib n tFime i§ a ^aj^bjc determinant of charges*-on some time-sharing 
services.^ . / 

exposition mode 



See^ "tutojr^iijl mode." 

facsimile (FAX) Transmission of pictures, maps, diag;rams, etc, by electronic 
means/ The image is scanrfed, transmitted by telephone or radio, reconstructed 
at the receivlTig station^^? and. duplicate of paper* 



y^ X feed bj ??rlc ^In_pr;^cgrammed jLnp^ruatlon,^^^^^^ Is^ information supplies to the ^ 

stuSent iiegai^l^^ cbrrectness jp$ his last statement or 

S^. ~ res^ppn£>e:v^^^ to confiTm a correct answer or to 

^^S^ . Improve aar^fofi^oA^vone^^ - - - - - - 



~-.-'if~^--zJ --J-~ 
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flag - An ai^gicator ofe!sj)g^ gonditlon re cog gu^ed by a coiS^ter procedure; - 

_sQmettme_%:Tecpr^^ ±n computer memory, 

-Typij^ally- a.^^^ :f^^$ritijte^^ the step at 

whi^a /the; con& an^ AMBJG_pMnted af ter^a program 

s tatamenfi :wh pidcessori t^b e amb igyou^ , 

flow ^dla^ram C^Xq^ .o^T^loAk xej)re^ita^^ 

s t%^t e^y^/^^^ can be 

j^res^en^ed^^S^^ ' 

^JtamC _ T)heK snia^lies t^^_u^ true tion , A CAI frame usually 
<^ji^ist§ faf for an answer, and 

^ s^m^^pf byf sigjlr f 6^ 



generative techniques Stand&d piatterns/, procedures or algorithms applied to 
:£fi5£ijculum f^ f ox tfe /generation or assembly of sequ^^^ of instructional 
^teriVls, penera^^^^ alternatlve\:o programming 



^ tti torlal ^niatefd^^^^^^ .^b r d-^by-wcrd , 



half-QapIex ^ In coiDmunications 
in4eEen3en5te^ tcattsffiission (sometiinea 
with "duplex.") - ' - - 



/ 



, ref (ers/ to an aitemate^ one^way-^t^-a-t 
titnes^^f erred to as "single") * (Contra 



ime, 
bntrast 
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Jiard^ara The equipment components of a compute-r system; the machlne.ry as 
opposed to the.jprograms which are run on^ C\he machinery, (See^'sof tware, ^ 

heuristic An intuitive guide to finding a solution to a problem; a problem- 
solving strategy. (Conj/rast with "al^orit^*") ^ 

individualized, instruction Adaptatipn of instructional, methods and 

materials^ to a learner^s individual characteristics and background* 

> , - . ^ , _ _ > * 

information storage/ organization, ♦and retrieval mode (ISOR) Use of the ^ 
computer. to store, reteieve and assist in the reorganization of information 
about., a subject. ISOR^Cor ISR or IR) is an. established area within computer 
science* ' . • » 

instructional pKogramroing ianguage __ A cbmpiiter language or notation 
particularly suited to the desprlptioa of instructional procfdiires for 
computer -delivery../ (See^^"^^^ - / 

Ins^uctlonaU'U^^ .information 
processing/ sciences t:0:;WsMsl:^^& and learning in jducatlon , 

an|Vf itt &e de'^elopmeht;: o£?fleafning :ma6% ihf ofmation * ^_ 

.. IntjsragMve mojai v Comput^^ is given to the 

Icontlnalng exghmige^jietween u sei^ -Xypi^^lly^ _the-4iser- 

Ttypes %ns tr^^^^ back /q^^^^ otherwise . provides) ^partial 

^e^A^ttSTj^^^^^tyn^ttS^ h^^i^^kiaa^- states ^ continues with new 
"instrtfctlon^^^^^^^^^ lnteracti.ve drill program 

Jchecks£^the:^t^^ iiTOedlatel^^^ the user; 

an^ip't^J^c^V^^^ok^^ 
^ui^^-gfd^aS^^ _ (For non- 



) 



interface- 



/ 



A^/iihat# bounda^ boundary between two sub sys t erne 

dr :tw|^e^ices^^^^ 1 bx^ctwiyr provide rthe in ter f ace between a 

tennjnil,^^^^ the interface between thf 

us]C?tafia^ sy$ t^m> j 



inter0ret^er ">A pro guage translation (e.g^^j BASIC to machine 

iangu^%e)5Vi Ly" equivalent tg a "compiler except that 
:gach^s:t^temSftt^^^ right after translation, prp^ldlng the user with a 

rapid respohse to small^st^ and a dynamic working environment. (See 

:^*tran&a:^^orS^*):v^' v 
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interrupt A; hardwaTe feature which allows -the signalling of asynchronous, _ 
possibly -u nplanned, events within a computer » Usually the computer ^^^^^le to 
stop its current task, process the interruprt task and return to the orxginal . - . 
tasUithout loss of resul'ts. -WErrupts are used by asynchronous fyi^^^^ ?° 
indicate their current status, an^ by CPU's to indxcate the .f^^^^^^.^ 
conditions. The Interrupt a hafdwaregfeature; the processing of ititerrupts is 
performed by programs known as "interrupt- routines . ■ ; 

% ' '. . ' * • 

m-ihlS Similar to i.'ATS but^, allows inward "caAs at a flat mdntHly rate.; INWATS 
prb-vides a kind of automatic, collect staftion' emails , j 

r/O inputs-output of information to and from computers;. 1/0, usually refers 
t^devices such as an electric typewriter, card- reader and punch, paper^tape 
-reader and punch, printet, etc. / - , . 



IP'I 



(individually.Brescribea:^Iifst%tio;^ to curriculrum which 

originated :#ith an ihstruc at the University of Pittsburgh s 

LearhingaResWarch and De^^^ as a label for a 

:sjct4fcei£^ftandij^u^ the i^te of work 

job An independent set of instructions and data submitted to^a computer for - , 
processing; the computing done between entry onto the computer and exit from it. 

- 's tsEci^^ teelS^trmilcHail^^ position ^o; a computer r 

"45r-^ga^^ifco^mov&>a^cu*s]Or.ab^ 

^il^SaifSSp^^^SStSctee^ (See also 



K Thousand; e.g., 32K words of membiry means 32,768 words of computer memory . 
K means 1,024 or (2-^^) when applied to computer me^ry since it- is usually 
constructed in units handling a capacity measured by a power of two . 

learner control mode The designer of an exercise can provide the user with 
almost complete control, programming the computer to serve him as a tool in 
the management of information and procedures useful for solving a prob lem 
or achieving some other goal, relying on; user initiative. 



LDX (Long Distance Xerography). A name used by the Xerox Corporation to 
identify its high speed facsimile ^system, the system uses Xerox teriiiinal 
equipjjient and a wide band data communication channel. ^ (S ee facs imile. ") 



(student response time) 

iimulus to the start (cJr co " 




The time from the display of an instructional 
of the student's response. Latency is^ 



a measure of student performance, especially in research studies. 
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Miiear proeranraiing a) Mathematical: te^^ 

iHfofgS-rfl variable, subject ta linear ^^^^^^^^^^ ^ 
or "all- of the variables; b)- Instructional; the simi)aest form of programmed 
. instruction or-CAlr all students follow the same sequence. . 

liae- switching -rHe.switchi^ technique of t emporaril>j 

so that the sta tions directly exchange information. Ordinary telephone 

connections through difl-iip ser^jice are" achieved by. line-switchmg. 

link See:;"chaTinel." o _ 

lo^: To. «cord student-corn^^ and/or p^rform^ce^ data; a record - 

; of i^jjdenfe-compu.ter ifiteraction . r . > . ' . 

raemorv The storage components' of a computer .with which , , . 

^ ^i^e^lsio?; vStorag^^ ^ ^ 

'QS^^^m5ffiil&^^ frequency ;spect|um above 

S^S^leitper-^icbti^ economic means of 

is justified by continuing use near full capacity.. 

H.^.ioj.^n Project CLUE.) 
; SgltliStiSrtlKc^^ ^ le to^tudents 

,3SSMcamifigs>^hey^^ 

:^:;aiW«Kl«=i±^l^ ^ suitable 

model definition; language. (See also "simulation. ) ' 

^^SSStO^aSfe^ tae^^^ f^^^^^Sio sSnalf 
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mouse A device. for determining the location of a cursor on a display screen CCRT). 
AlSilse-like box is moved about on- a horizontal surface under the user s hand* 
causing a cursor (RBl-hter) " to move up in a donrespondlng way on the screen. 
(See: also "joy stick," "RAND Tablet," and "light-pen.") - , ^ .. 



\ 



multiplexing Using a skngle transaission facility divided into two or raore 
subchannels. A school may rent a single phone lln^ to the site of a xeusjte > 
computer and serve 16 *user terminals "simultKjeously by multiplexing. ^ . . 

\ multiproces'siog -A method of operation |n which 'componSnts of a computer ^ 
facility are shared by, several users for different- purposes at (apparently) 
tlie same tlnie . Although each device 'actually services one user at . a .tls^t 
the high speed andi^multiple comporients of tKe- f aciljity give the outward 
appearance of handling mmy users -simultanepusly. jMultiiprd 
ma^mize'the Qse of^^haraware^ 

"timesharing.") . - ..: * * 

, natural-lan^uai^e-proces^ng. modeF ^ttempt to program the computer to ^^^it the ^* 
student user mayt^espond with term-s and^iconyentloni natural to- hlm.^and Jltge 
if anything about tl^e system operation need be leatned to use it. The ability, 
to-process natural language, ancf subsequently to diagnose and prescribe on the • 
basis of statements made by the student .without any constraints, approaches the 
' realm of "artifitqlat liteSi^^ - ' ' ' 

off-line Processes' pQ^i)^^ the central . prasfssor 

^^^?rr^utdjig-s^scem.^e.:sf^ : 
^^^nput tap^ fpfc^^^ . 

5 on-line" donnictei direcl% to tlieJlen^ral cd^^^ e.g. , an electric type|riter 
in direct communication with the computer processor.. - (Contrast with off -line. ) , 

. operating s ystem Th\i collection of ' programs (software) which- direct or supervise 
' the utilization of 'prbc^sing components and the execution of other programs. 

partitioning Using a computing system as functionally divided into two or _ 
• ^re subsets so that different tasks, perhaps batch processing^ and on-line 
processing, can be given different priority. That is, one subset may be. 
. programmed to respond^apidly to on-llge users while the other works on 
lower priority jobs. to be handled as. CPU time and working space can be made 
available. .. . _ ■ .• '' ^ ' 

Plas ma panel A flat, gas-filled panel for display of characters and diagrams 

elective signals. ' A plasma panel was ^designed- at the University of Illl|foi3 
to provide -a durable, low-cost display device with, some nexibility for writing 
and storing information at ^ student;,.&tat'ion; z- , ' 

. polling a' centrally controlled method of calling a' number of points to permit 
tjnem to transmit information. - >: - 




. >: I 



port/ The physical facility f^r connecting ^S-pho^ie line coming in from a user 
terminal to the comp^ rer- ' ^ 

practice mofe Computer use in which the, learner is given problems and a 
facfility for solving them, or is otherwise aided during successive exercises ♦ 
of /a particular skill or technique. The practice raode of computer use is of 
mujzh b'roadeir scope than simple "^rill,* * ^ 

problem solving mode The learner knows a langujage or notation that per^ts* 
Wim to enter into the computing system .data and t he s teps by which the computer 
ight work' out a solution; ' 

: ' ^ ^ ^ 

programmed instruction A strategy ior the development -and validation of 
instructional materials which uses a step-by-step_siethod (or Srame-by-frame 
specif ipation) for presentation of the subject matter, This^ strategy has been 
applied to the development of materials la various, media including textbooks 
and computer-controlled audio-visual mat'sri^l^^^ ' ' * ^ 

programming a) Instructional: the construct^oiPand. arrangement of elements 
of a learning exercise and perhaps selfc-testing in a way specifically designed 
to promote effective and ef ficlent, learMngl b> ' Comp uter: the construction 
and arrangement of elements of a> procedure specifically designed to achieve 
a problem solution or to demonstrate a process_..___(See^lso "algorithm" and 
"fl^^iagram,") /_ - - — ^ ^ ^ 



RAND TablgJ:. .^^-A"'^etai writing surface developed by HMD CorporatJ.on for input 
of""gfaghie Inffarmation to a computer through use_oJ a sp/:*cial writing stylus* 
(See also joy stick,*' "light^pen?' and "mouse; ")^ _ " ^ 

- _ . ^ * _ ^ - __ - ^ ^-ft^ 

random access Refers^ to -a facility whereby information caxt t)e returned from^ 
any part of a storage device rapidly at any time* Diskpacks and drums are 
•random access deyiceis ♦ (See "sequential acdes^ * ") 

real-" time Performance of tprociissing during the actual time the physical process 
trai.spirea, in order that results oi^the coffiputation .can be used to guide the 
physical process. For example / real-^tlme cmsj^fpHg^ is requijred to determine 
the correction J^cto^ from telemetered data before a rocket is too f^r off 
course to be recovered* ^ ^ . - _ 

remote-access Use of a computer from a station some^dlLstance from the central 
site of equipments Remote access computing lj_usually accomplished through 
connection of a telephone line or other electronic tr^trsmission medium. 
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response time > (system response) The amount of tim^ which elapses between , 
generation of an inquiry at a user terminal and- receipt of a response from the / 
computer at that same terminal. Slow response time tor educational users of a 
computer system often leads to frustration with the instructional exercise and , 
to dissatisfaction with computer aids, (See also "latency.") / 

RPQ .(Request Price Quotation) Special equipment features' which might be 
obtained by a purchase! >n request but are not included by the vendor in his 
price lists. The RPQ designation permits, a supplier to mention equipment 
additions and modifications (which might be useful in educational settings) 
without having to work outi a detailed pricing pblicy before the demand is ^ ^ 
known* . * ' . 

scholarly ^aids mode Computer use in which the processor, procedures and datB 
files are put at ,the disposal of the student as a scholar fh the discipline, ^ 
Scholarly aids might include information storage and retrieval, text processing 
and analysis, model constructiojn and testing, and specification of complex 

displays. . / 

^ - - . ' > .* » 

sequential access (linear access) Refers .to a facility with which the storage 
and/or retrlevat of desired information .may require some uime to skip past 
large quantities of irrelevant information. Card readers and tape readers are 
sequential access devices,^ (See "random access,") 

sign-on and sign-off (also l^g-on and log-off) The action of registering with 
a supervisory system (which-may include billing procedures and records) for 
use of computing f acilities^^ and a latter action of terminating the period of 
use. In a. typical sign-on operation, ttttF user types fof the computer 
identifying information and perhaps a password which indicates permission ^o 
use the computing^ facilities and information files associated with that user 
identiflcatfon, ^ ^ 

simulation and gaming mode A conversation between student and program in 
which the .results^ he obtains follow, a mo*Bl of a realtor idealized situation. 
Simulations attempt to model some aspects of the real world for study and 
. research. Computer-based feamesiisuaily place the student in less realistic 
situations, provide specific payoffs, and introduce competition with other 
students, \ * 



skills practice mode See "practice mode J' 



software a) Computer: programs as contrasted with computer components* 
(See "hardware,") b) JnstTuctlon: curriculum materials as contrasted with 
computer facilities or ^e^^ Many .people . working ron innovative computer 
uses se% the^^^^^ with hardware (size of 

computet memor^j^spe'ed ot^procesalng, and capabilities of user terminal) than 
with^sqft;:ate7Xco€gutet^^ grams and curriculuin loaterials)* v 
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station One, of the Ingot or oy,tput points' in an information processing and 
■^^ii^catioL system. A user station typically includes a keyboard for input 
to the system and a typing-'element for output. 



storage. The capacity of an informatifin processing system to save l^^^^^^ion^ 
f^uture use; also used-to refer to a system's storage devices. (See core 
and "disk.") _ 

storage protect A hardware feature which prohibits one user in a shared 
System from iiifidvertantly using or changing information stored in memory 
allocated to other -users. • » ■ 

student station Equipment designed for student use in interactinj with a 
compute-. A student station includes. components for input (keybolard^- 
liekt4en, mouse or RAND Tablet) and output (typewriter, typing mechanisms-, 
imagelprojector, plotter, CRT, or plasma panel). (See alsQ terminal. ) 

tape?(magneticor paper)- u\ed for storage of information in computer system 
liidln the shelf. The tape \irive, having the physical appearance of an audio 
playback mSt, is a serial access storage device; it takes some time to pass 
-WerunwatTted-ltiformation when^earching For ^the^unlt of_instruc£i on a 
stuSent needs next. 

teac hing logic A pattern (or strategy for instruction) 'into which various 
topics ^r sets pf questions and answers may be placed. A number of teaching 
logics, have been proposed; each "author language" implies another logic. 

teleprocessing A form of iaformatlon handling in wKlch an information 
processing system utiliEes telegraphic coirimunlcation facilities. A student 
using a computer remotely ^ia telephone llftes Is using teleprocessing. 

TWX* ( tele typewrlteir exchange service) An automatic teleprinter exchange 
-switching service pro^;ided by the Bell System. ^ In a sense,. TWX (sometimes 
pronounced "twix")' is a speciaX telephone netwk just for conversations 
between ^ teletype and a- computer (or other teletypes). 

telpak A service offeredTjy ccpnunications common carriers for the leasing 
of wide baud channels -by the month' (available 24^hours per day) between two 
or more points. vFor example, "telpack>" service provides the equivalent of 
12 regular telephone lines in a package for the approximate-cost of leasing 
four regular lines separately,: Widj^ band^ communications soon will be * ^ 
availa1)le through switching: (dl^Irup) networks with charges .made by the - 
minute, of use rather than on a monthly rental basis; 

^ =1 _ _ * 

terminal A point ac wKlch information can* enter or leave a communication 
net^orki the F/0 device used at that point. (See also ''student station. ) 
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C text analysis mod e 1 Use o& procedure/for editing analyzing text by -an ^ 
luthor to adapt learning ma-r rials /or other users, or by -^^^udent to 
interpret and cri/icize work in the discipline preparatory to seminar 
discussioi} by a group of student/. - . ; 

tie Jline A oAvate-line commj^^lcation channel of the ty^e provided by 
I^S^atio/s common carriers for linking, two or more P-nts together A 
tie line is/paid for by th^ month and available to the uper 24 hours per aay, 
point-co-|,6int. (Contrast' with "dial-up service. ) ( 

time-sharing The use of multiprocessing with. emphagis dn the ^^"^^"^^ 
the user who is runni^ an interactive job. Although ^--^^aring applxcations 
■ Tn.nlv% racid interaction bet^/een user and computer system, som^ batch jobs 
• ^ (tasL prepaie" of processln^-at the convenience of the computer system and 
operator! perhaps^th others in a batch) can be ^bmitted to a computer with 
some convenience through a* time-sharing system. ; 

-ranslator A computer program which accepts statementi^or instructions 
^Sg~^-o.e.ianguage'and produces statements in -o^her language or perhap. 
direct instructions to the computer for execution. (See compiler .nu 
"intepreter-^') — ==c_ 

turn-around tine The approximate t^me require.d f or completion of a b^tch job. 
.^^^^o^^^:^^^.-^^ deck) to availability of output (e.g,, 
printed results i. - * , , 

tutorial modi Computer use for p^menting exposition-in which.the author 
iF^ifc^S convLsational initiative throughout by defining objectives and 
describing the subject matter in considerable detail. ^ 

Wee «rade channel A channel (e . g . , telephone connection) suitable for 
T ^smiision: of spee ch, generally with a frequency range of ^^out 300 to 300U 
Ss plrSecand! DigiLl or analog data, or facsimile reproduction can also 
. " .bSjan'S JeX over voice ,r ad e lines Cchannels) -if ^3000 cps is,.suf£l^en^__ 
for cbesignal^^;; . - 

!JAT<; mi^e Wa Telephone Service)-7^-service piroyi?^ by telephone companies 

plikitt a cus to^r lo make calls to Velephon|iin some distant geographic 
zone on a dial basis for a- flat monthly charge. ^ ^ 

^ - vord A set '^f bits sufifi.-Sient to Jexpress one computer ins traction (usually . 
iii to bL« lo'^g* depending on othej^ characteristics of the machine). ^ 
Usually the equipment ds,»lJ;ad to transfer one or more words of Information ex 
' a time. , ■ ' . ■ 




■ December 1970 

.Project- CLUE. , , . . = 



f 



VOLUME II. 



A- 



* 



/ 



1, Introduction- 

* <- 

This -second volume includes some of. the working papers ai^ther supporting 
materials o£ Project CLUE. It- is not for a casual reader curious about • 
computers and their uses in- education; .he should find that the tutorial ' 
material and guidelines in Volume 1 are more" suitaBie. 

Sections two through seven of this volume present tH.e statements, of position 
and points' of view which were used" to initiate discussion and provide a 
framework for argumen£_about__tl^^ 

-^titSiStT^i^T^t intended -to present n^w ideas or evaluative summaries; 
■they provide some reminders of .^ha-tkas been said, and serve as a guide 

to points of, view for one interested In serious study of the field. Each 
section was assembled by staff .of Project CLIIE' from published papers, 
unpublished^ technical reports and some personal cj^mmunicatlons , A draft was 
sent t« each person referenced, snd a revision was prepared uplng all replies 

treceivedV A second draf^ was distributed to a select, group of readers just - 
before the annual meeting of the American, Educational Research Association, 
February 1970, and discussed at a special session there. 

The readers were quite critical of the position statements discussed 3,t the 
AERA meeting which correspond to parts 2, 3, 5 and 6 of this volume. The ' 
major ^problems werefiparaphraslng out of context, implying equal valu^ for the 
views of persons bf^greatly different experience, and confusing the reader by ^ 
placiTig Vgether^^^^^ attempted to correct 

thei errors but ^chose to leave t^^^ as they were taken from 

pubSish^d literature, . providing a- sample of the literature as of February 1970, 
with all Its faults, confusions and conflicting views^ 



Elucijtional technplo^sts^^a^^^ reacted" mor^JTavorably than the 

educatlonaVreseardhe^sl^apparen statements does succeed 

inVprovldJng an liit^^^ pointing out differences of opinion on 

cant matters. . - ; 
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II 1 Introduction 



One of the important contributions of Project CLUE has been to bring together 
different points of view about instructional use of computers, including the 
different perfepectives of researchers and practitioner^,, and to provide some 
coimnon framework for discussion. This can b^ done without causing one point 
oE view to interfere inappropriately with another, and without permitting 
conflicts to restrict communication. * In fact, the contrasts brought out by 
the position statements aiTd other documents appeared to have enhanced ,the 
climate for new thinking and exchange. ^ _ 

The app^endices of the volume provide information .about ch^ mechanics of the 
study and excerpts 'from working papers. Appendix A describes the procedure 
followed and lists in some detail the formal dissemination activities. 
Appendix© lists all projects which were contacted during the study to 
obtain aft confirm infot^ation about current actiArities, -^Notes actions 

which might be taken by prof egsional societies and other organizations to 
ptomote ef fee tive comput^l uses are, included in- Appendix Cj -the important 
xole of the prof essionai i^^^ separate 3 tudy or conference 

or spee^^iaL disseffiinatibff ahtivity . Appendix I> includes inrormation about 



the working papers- on ^^ompUter l^ngulge design, i.e., the contents 
andTiiitr^cjtion: pi? ex^ ^urce ql the papers themselves has 

beeh=;iJicluded.r. - 



X€"must"be^e^hasi2ea^ these st at e^ments of points of/ view 

(Chapters 2 fchf oujh 7) are ridl^ ahr evaluative sumtnary of the topics named* 
S ^Che p^^ from>^the literature provide only a starting 

/pofnt^for disfeussri^^ views expressed, especially 

as rjthey:.%pear^^^;t^^^ the fielCand prescription for 

new directions^ of research 
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2. Management * Operations and Costs: A Statement of JPositlons and' 



Points of View^, 
L. MANAGEMENT CONCERNS 



A. Planning and .iJrg^izing 

B» Administration ' ^ ' " 

€♦ Personnel li'eeds: Recruitment and Training 
1- Shortage and sources 
2, yTea/fiiers and the new. technology 



NG THE INSTRUCTIONAL SYSTEM 

A* /choosing a Type of System 
J., — Capacity-and-si^e- 

2. Purchase or rental 

3. Organization and administration 

- ^ - ' * 

Equipment and= Maintenance 




III,/ PRODUCTION ASD OPERATION COSTS: THE..ECONOMICS OF CAI 
/ A* Funding Considera^^^ ^ 

B. " Factors Affecting the Determination of Costs 
'Cr: Achieving Gost--E£fec^iveness * * 
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CAI vs>> ConvehtibnaT^^^ Instruction 
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•IV. A VIEW OF THE FUTURE 
V. SOURCES 



* These ; scat^en ts Ji^v^ B een 
to represent various po ' 
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rora published and -^PttpgW literature 
^ cernin^ opjixating^^^^ and •> 

soi^^altereig^tff conW^ Jtlie intent in a 
text of a la^e'J^utllne^^^ to jppirit pat similarities 

/^afd^Bl^fere^^ 
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II 2 Opera ti,ons 



I. MANAGEMENT CONCERNS 



A. Plaonlng and Organization ^ *; 

Of paramount importance is careful and sys'tematic planning which anticip^es 
those obstacles one can expect to encounter in any innovative technological 
designr '^ 7 [p^^^ri] i \ ' 

.Apparently many Individual's- planning new curriculum 'development or,coraputer 
applications programs jdnderestimate the requirements and benefits, of careft^l 
*brganization and management. . Many-.projects' fail to complete and put into use 

a substantial^^ set og materials primarily because of lack of 'planning, ^ 
y - " f , [CLUE staff] • 

Computers WLii- never be useful 4n this schools umrfefB these tschools «re, 
drastical^ reorganized ahd :%pio|^^^^^^ cb abfejrb ;4-eform: The 

^ discrepant between ultimate pr^omise.^ posslbilLlty becomes apparent 

in the comparative examination of the properties of school systems and the 

- properties- of other so^al systems t^^^ have prroved to be receptive to: Innovation. 
. * ■ ■ [Oettinger &• Mdrks] 



■/ 



B. \ Adfflinlstratloh ■ * * - • • 

No one.has yet faced the scheduling problems entailed by even the limited 
amount of individualization provided by the new technology. The increasing 
divergence of even an Initially uniform group of students i§^. considerable. 
It is probable that schools in the sho^t time span of the next decade will be 
nable to take advantage even of the pacing flexibility of computers without 
the kind of major administrative r volution that seems conclusively blocked 



by other factors . 



[Oettinger & Movks' 
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Use of CAI without provisions f\r the aJceleration of faster students through 
the school system is .very costly Xheoce I CAI exerts a pressure favoring more 
'rapid advancement of the better sttWn.t^'. ' , [Tlandall & Blaschke] 

Administrators rather than technologies must lead. the way in preparing- for 
the. new educational technology, and preWation must begin at the lowes^ ^ 
"manigimiirt" leveI,: tHit is^^^^ T ^^^^^ ^^^^ \ 



I 

Cv Personnel ;Needs: Rectrultment rfnd Training 



1. ' Shortage and sources 



/ 



C ) 



One should 1iot"ai:qui±«i equipment that: may sit around unused. for lack of 
technical personnel and othei^- assistants. However many budding projects may 
be faced with what -to do witl( money promised for facilities without personnel 
*an-d without |ssurance of ^a l?ine item in the budget for either rental or 
pfersdnnelh in the foUowingi^ar; - [GLUE Staffl ^ 



A critical shortage of qualified p«f»oimel can be rMwdied by efficient 

retraining programs which s'hould'in particular promote a new role for the 
teacher as a manager of Instructional processes and tools . An important 

sduE|^^6f^^^nea^^B^g^^ i^^^^ staff] 



2. Teachers and the nev technology 




It is an absQlute necessity that classroom teachers and the public schools 
be involved es full partners in th--^ development of effective innovation in 
American public education. {Pagen] 

Teacher feaf, upon e..po^,ure to a C.\^ prograin. rapidly vanishes and is soon 
replaced by enthu»i»»«. ' ^ [Prince] 
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II 2 Operations 



Hardware /and Vys tern develcpmenL presently receive the major portion of . 
availd^ll funis; ihstructional applications and training programs are assigned 
"lowerbfe^ University teacher' training programs do not 

meet the demands of the new tech?i&logy. tC^UE Staff] 



II, 



OPERATING THE INSTRUCTIONAL SYSTEM. 



A. Choosing a Tvtfe of Systam — , . ' 

1. Capacity and.size ^ ^ 

A. small college: may begin with one computer on campus, computing 
^ use grows' and:^Tsifies. 1 split into separate facilitieg becomes desirable. 
At a l^ter'stage tt.may be worthwhi^ to combine faciLities again into a very 
: lairge sys tm." In any ; cas^, economics of size depend on use and management. 
; \" . . V, . [Viavant, Vol. Ill 




For instruction to be provided at a reasonalbe cost, the cdtaputer* system 
^m^stSE^^^rg^W^ pupils at the 

^Sftalii^op^SB^ 
g|g^;^^g6ph^^ 
|^e|t^upSyptui^ 
Q^^^§a|pg^Va5g^e^^^ 
e.g., buy a small computer and also rent timl on a larger, more flexible 
system for uses with.jnore complex requirements. V [CLUE Staff) 

solution 'to iize and cost may be found in small computers wording as 

safel=itsWlttP^ - :^ iCLUE StafTI 



1 - 
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2. Purchase or rental 



A primary consideration is the relative efficiency of a university vis-a-vls 
commercial enterprise in the provision of computer se.rvice. Simple economic 
arguments suggest that many universities should purchase or lease terminals, 
and allow faculty and student^ to purchase services from outside vendor^. ^ 
as their interests, needs and budgets allow. \ [Sharpe] 

. ■ ■ .. ■ \ 

The cost of local operation of an Instructional system ihlch provides only 

% \ - 



ral-purpose 



one language may be mifch less, than similar operations on^ 
system providing the user greater variety o£ c|pa6ility. Ni 
potential author who :does not wish to commI*himself to a spe( 
educational system. or*the school mch^^shes to^ ^omfe^xp^ience without 
J^rge investments :itvjp3ce.:^leasing arrar^e^^ or committed use\time . will 
find the rental :df tirminals for: use^ of 5 ^general-purpose/ time-shai ' 
system to be a satisfactory Interim .rrangemetit. iZlnn, a], 

Wlocation of smaller colpute^^^ schools will i^so«e meaau^ 

cut coMiunicatton: cost^^or a school sy3t|m.. The data processing computer 
at a^-ce&ral site ij fee- 1^^ prime time educational data processing. The 

^rnmtiin^eiessary^^o^^^^ 

. r ' ri>rincel ' 

by a batch processing procedure. * - I'^V J . • • 

A li^e^^tral-iaclli^f se^^^^^^ economfi:al than 

^;p^i:nptS:%ni&^g^igwlt^ ^ lof^ separat^smaO. i^stallatiops|^, / 

Sulf a^acM% iund« th£ conK^^ ' 
*^^:sfKifeo£ c6SsultaatK:the|.ssi^^ trai^ing/center. and 

"3^#iccess^SSe^Sl&gpr^ tKe c^raL uniye^ty^rated 

^ cb^t^ttmC centi^^veiingltHe^ completS^ computer application .:at 

suc| arstorel^use lot knowlSag^ means that |he 
"'Sfii:ah|ra6liVtt^ w^a xemote 

: ^£8ofcis.Sm£tad :o«Iy byfhis o«.^illty itHprobl^g the >«,.t recent .^^ 

• . - ' , ' : [Lykos] 

in computer science. ^ . . .1 ' ' 
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■ .11 2 Operacions^ .... " . . * ■ ' ^ '} ' 

B, Equipme nt and Maintenance' ; - , 

; tt is important to know exactly what is needed and then to request that^the 
•manufacturer provide such a system* It is also imRortant not to ask for things 
which the manuf actuter is unable to provide you; .this would f^^e him either 
to withdraw frpjn the, bidding, or include in his pricing the costNjf developing 
' -a prgdu.ct to meet your special needs* In-^additian, one -should clearly define 
when payments' fo%^a system are to begin, whether it xsi being purchasedXor ^ 
* being ranted* . ' . , [Dick] * ^ \^ . 



rjSe^eyelopment of innovative software and of new and more efficient procedures 
using 'systeih timeshari*ng routines is an esseatial function of a!pr6ject*s " \ 
operatipna. Records should be. maintained pertaining to data on system 'and 

. technicaL usage time and cyostsv as well and down tim^ for both 

-kchedtU.ed-^d unsche^^^^^ (Bimderson] . * ^ 

we, are to continue- the developiflent of -on-linej» f ast-response^iftoraation 
sjfstems, wa muat look for ways to provide service *Vli the time," As increasing 
numbers of people come to xeUy^more and^more on the use of the ^computer as a 
rouWnejnalgei'^ we must impose a^ req the system perform without 

"3erlou_s."^interfcuptio%^ the hours between 6a*m* anj^^ midniLght. 

Ja the university con teKt, tfie quest of reliability vs. mainjrainability is^ 
siSili not^respived^i^V^ ~ " y . i : ^ t^rdon]. 





December 1970 



If ^ 



I 



^ " - 

^ _ 1 

: \ 1 

:-_ - 




_V - ; c *^ 










I M 






1 J\ 










\ * 



IM. /PEODUCTTON AND OPERATION .COSTSt THE ECONOMICS CI, CAI ^ ; 
A* FundxnR Conside rations * ' . . , ' 

Extensive, use of computers for instruction in colleges and uni^JFersities eveA; 
if demonstrated to he more- effective th^ conventional instruction, requites 
at .ieast one, of 'the following; - a) instructionaKbudg^ts will nofc.bB^slgTtificantly 
greater than'with conventional instruction, oir b) Wderal funds are. available 
for general support .of " increased costs of higher ed^on, or c)Jederal or 
other outsik tunds are provide^ specific.ally -for ac^^tion or operation of . 
instructional systems* 



.i 



iBarro]! 



■Rie nc^ssary research and devgopment cafc^not^^^^ 'financed adepately wlth^ ^ 
funds "stolen" from operating iudg£ts>:Prpp^^^ those 
wh;;^4 ±nvolyea--^axpa3^r, legisiat^^ teachers, 
students^ *aren tbe^wortfr^pf y^being ■ 

'^Ehat will nbt be. -sy. since' introduction of computers >wolve^ an ina^e^- 
4tyie^taiiost:a educa^ acc&pcable 



L 



[Gordon] 



\ 



The introduction -of computers need not .cause at. Itiarease to Ins titutional : . 
-budgets beyoni that:;:aaticlFat^^^ 

' £f V- % fed&ta^^rtcSLk^^vi-^om^^ a jE^w iarge-scale ' and / - 

WgWqualllg^l^^^ ateasJfevant to actual; 

- Weds of variousl^iTisti^^ . ^ 

^r^ivatefiu^t^cpntrlb^^^ systemsTde^lcyment, increasing 

■ the relevance for solving educational problems; f ■ ^ - ^ 

3) :publisKfeani^thek R^^^^^ ? great' variety 

pAurrici.im-?|atext3is^^^^ ^ • 

iy.pjvatf .OE^fedeTraliources induce Inttiai demons ttafions^Md cQnti«^ 
difftLiion effort, perhaps through national commissions and professional 
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Innovation can ,not be accomplished in three years. Government spo^orship of 
new progiams must provide for'the dif f icult^ransition from the devel^^pment and 
demon^cration to the op^tlon^l status in tfeejachcdls . , _ [CLUS^^staf f ] 

* • ' • . 

B. Factors' i%f f ft*' fin ff the Detei^ifl atlon of Costs-. — * 

Prediction of -elatlve u^e of computers l^nstruction nvolves such 
diverse variables as: the state of computer rt^nology; the attitudes of 
participants in Jche education process; developments in instructional science; 
increase in costs of '•conveutional'' Jn^tructiora changes in educational 
programs and curricula; future developments injtlper education finance, 
and' a variety of administrative and organizational c^ortsiderations . as well 
as. costs per student hour of use. iBarro] 

Prediction of specific costs per student " hour rf>S-truction must be based 
on forecasts- about developments affecting verdl aspects of CAI systems: 
hardware technology, software technology, -Initructicnal strategy, and the 
kinds of instructional material found useful/ :?erhBps niost important, CAI 
costs will be strongly affected b> .he degr<i^i> which institutions are able 
to modify certain- of their organizational characteristics, and to develop new 
modes of organizaaon, where necessary, in ordgr to mrke economical and 
. flexible use ot computers for instruction. _ —--^[Barrol ^ 

E-ach weekV the average, midhex spends about; tenr:hours_^dolng "home^6rk" af ter ^ 
school. I Since this time is no,t reclaimable by the school system,':khe teacher'a 
, salaiy Mist be consider^.d, for' all Wcticai-pur-poses^ to cover only her fime 
spent physically at school. — -~ 

Costs of preparing recorded or pro^graiamed^instrucclonal material for 
presentation througli technology-based systema_i:^ilwE be jpstified by offsetting 
savings- of -teacher's time, since the "Specif ic time sived ("hdmework" after, 
saool) is a "free" resource contributed by tradition by .the teacher to the 
school ^system and not reclalmaWa. Hays oi -profitably-employing tlje^ teacher's 
fWe resources within the new educational. tkcKnolcgy must be^found if the 
benefits obtainable from them are not to be lost Ic'^ver. 

[Iwidall & Blaschke] 
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Future costs*of producing Lesson material depend on technological developments 
such as improvements in CAt author languages and instructional strategies. 
Progress in the computer software field ought to reduce the cost of pro<?^cing 
instructional programs of any given degree of sophistication* However';* this 
may be offset if progress in developing instructional strategies results in 
more sophisticated, more responsive, and more indivi,dualizkd lesson material* 
Tlierefore, there are two considerations: 1) How elaborate a computer program 
will be required for each. type of applicatfon? 2) How will future developments 
in prograsmning languages and data structures affect the amount of labor 
required to produce a pragraa of giv^n -complexity? [Barro] 

C. Achieving Cost-Effectiveness 

. - . '* \ 

It is grossly inefficient to consider the use, of .a computer in .a limited, 

daylight school, day. The economic feasiTji„ity of CAI will obviously increase 

'as the number of hours per^ay available for teaching is increased, because 

of fixed cost of hardware. Of course the current administrative model of 

instruction deriving from long-standing practices does not .permit the extension 

of the school: day, : - j \ ^z:t7^ 

..The cost p^T at-dent hour of instruction is a convenient but inappropriate ^ 
measure of the efficiency of instruction. The basic defect is that student 
hours of instruction are a measure, not o£ the output from education, but 

* * 

\ the input of student time. When schools aspire to do more , than merely 
^'babysitting", this measure of efficiency is misleading, 

[PosnerJ 

• * 

Assessment o£ effectiveness requires the definition of a measure of accomplishment 
which avoids reliance' cn how long the student spends at a computer terminal. 
. Studies of cost-effactivenep could proceed if the experts in some subject 
area, would agree on measurement of concepts acquired or skills perfected, 
which would apply throughout Jthe doomin of concern. ' [Zinn] 

) ' ' 
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The best justlficacior for a high cost CAI instruction system is a high 
payoCE. The most promising opportunities will come where traditional instru,ction 
has perfonn^d badly in an' important task and where greater effectiveness has 
a high economic value. [Posner] 

A project seeking cost-effective operations must seriously consider providing 
student and teacher access to the computer systetn at different levels of 
interaction and correspon'ding cost, from those requiring one-second res ponse 
from t.e co.put.r to ten minutes' ar an hour or a day. Perhaps the operating 
.vstem .hould advise each user on how to get the most from his allocated 

[CLUE staff J 

resource*. 

on the basis of p-esent anticipated costs, the financial investment required 
to install and operate :c.mputor Assisted instruction will restrict significant 
use of this instructional mW— ^he need to form cooperative arrangements 
among school districts is indicated on the basis o£ cost alone. These 
arrangements, should be determined by the numbers of students to be served ^ 
Without consideration of pVesent local school d^trict or state boundaries. ^ 

\^ [Booz, Allen & Hamilton] 

\ , - 

CAI will be cost-effective flrstMn adult education and training for skilled 
personnel. Many adults are "tu^M of f ' l>y a school environment. Individualized 
instruction iTappropriate for adult audiences which are far- more heterogeneous ^ 
than the Children in most schools. The opportunity to schedule learning outsxde 
of formal working hours is an improtant advantage which minimizes^ the disruption 

1 , ' \ iPosner] 

of work. s 

V 



\ 



\ 



\ 



■ 4 ) -j : 

Project CLUE December 1970 



12 



II 2 Opfe rations 



.D. CM vs> Cp n ventiongl Ins tr action 

If CAI were to. prove relatively ineffective, the degree of investment in it 
would have -to be scaled do^-^; on the other hand, If CAT should prove twice 
as effective and/or efficient as TAl, a cost as much as twice that of TAI 
migh^.L-^ acceptable. (Kopstein & Seidel] 

The assianption of e<iia^^^^ectivenes« of coaputer ai4d traditionsl techfti^>«s 
i^ convenient but noc J^^tlal for economic comparisons. E^f fectiveness 
usually is not equal; differences in e£fe<:tiveness should be measured and 
ir.itegrated into the analysis when possible Cost-effectiveness analysis 
techniques are designed for the situation in which conclusions must be expressed 
ai, trade-offs between incremental cost and incremental effectiveness, and 
they have the salutary effect of forcing measurement of effectiveness in spite 
m the hard work, and t\on- trivial costs required. * [PosnerJ 

Cost anslyses should Apt ^^3ume 1001 facility usage at all times; scheduling 
( ^ ' flexibility, student aibacnteaism, or equipsient troubles reduce effective 
* • use. For example, oit^ operational project with a 20-'Station system reports 

50 to 60% utilization^ Futrthermore, usage 12 months per year is not reasonable 
for many installation^* [CLUE Staff] 

/ . " _- 

It is unlikely that CAI will ever replace traditional instruction, ralher it 
will be one of many J^atntt^g tools* Cost comparisons should be made with 
other media (e-g*, television or l)Ooks) rather than with indefinite and 
encompassing **conveni:toj[ial instruction," of which media costs represent one 
part. Instead of .replaclrig the traditional > computers will reqmre an adjustment 
in the grganizational arrangements of institutions, ^moving teachers and 



supervisors of InstrUQCion into new roles and functions. 



(aU£ Staff] 
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E. Cost Estimates 



I. For hardware-. 



•Communication with the central co«put§r is a major cost of a remote 
access system. Jlie .development of inexpensive, wide-band clfansmission 
facilities would be of great value to all computer users, for short ranges, ^ 
the investigation and deveJ.opmeat of inexpensive laser links\may provide a 
solution^to this problem. [National Acadei.y of Engineering] 



In the situation where a large number of students are located at considerable 
distances from the central computer, costs can be lowered drastically by vsa 
of a coaxial line instead of the equivalent capacity in -separate phone lines, 
'for example, the cost for a 4.5 -Mlz TV channel is approximateiy §35 per month 
per mile, whereas the corresponding rate for 1500 3 KHz telephone lines is 
over $4000 per month per oilfi- [BitzerJ 

2* Foe software preparation 

The production of high quality .AI materials is very time-consuming and expensive 
The Equivalent of a three-semester-hour course^ in high school mathematics takes 
many months\o develop and the cost may W as high as half a million dollars or 
more. Of course, once it is properly developed and perfected, additional copies 
can be provided for other users for only a little more than the cost of the raw 

.7 ^ t fiklL^man] 
mmterials themselves. ' 



see 
o 



one often hears the figure of $10,000 per hour to .prepare an instructional 
hour of CAI materials. Even in tffe most affluent case, it is difficult to 
_ how this: is derived. There are economical approaches to the preparation 
f ai materials; as for 180;;hours of seventh grade science materials prepared 
to closely parallel the informational structure and instructional strategy 
found in the classroom. The total cost of $34,865.00 yields an approximate 
; preparation cost of $194 per instructional h^r. iHansen] , 

13 4 ^ niTTi? December 1970 
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The»t,utal project cost tor a ctllegiate CAI physics cpurse developed at FSU, 
when spread over ^0 hcnrs of instruction (30 hours of regular material plus 10 
hours of review), yiellis a CAI production figure of $5,980 per instructional 
hour- Of course the/ total budget included some one--time tiosts for additions 
to the ins cruet iona]| system used*, * ^ [Hansen] 

/ 

Costs per curriculum hour vary considerably depending on the goals, mahner of 
computer use .ippropriai ena??s of compucor sy*?te»^ rreviocs c^ar^icuJum de^veiop- 
ment in the area^ and accounting method for attributing various ?osts* Criteria 
for cost estimates need clarification, and potential investors (sponsors, 
administrators and project directors) should view such figures with a critical", 
eye, [CLUE Staff] 

3. For student use 

Data on cost per student hour can not be generalized because they depend on 
instructional goals, manner of computer use, appropriateness of the computing 
system used, skills and preierenx:es of the ^athor, local personnel costs, 
^outside consultatiojt, learning materials alTeady^vailable , -and^he-method of- — 
accounting. The range of costs reported (perhaps 50o to $35 per termina-l hour) 
only provides a very general framework. ' [CLUE staff] 

The average public school spent an estimated $18 per pupil for instructional 
materials during the 1966-67 school year, or abtout 2<f per student per hour. » 

[Booz^ Allen & Hamilton] 

% 

Cost, or cost effectiveness, in the short run is^not the major consideration 
in a decision to introduce computers into the instruction and course 

development program of an educational system. The extent and scope of desirable 
changes brought about as a result of the introduction of computers and information 
processing certainly are worth some additional investment at this time. 

[CLIIE staff) 
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IV. VI Bv' OF.yHE FUTURE 



Responsive environments foT learning will begin at infancy in the ho»e as , 

well as in special day-care'^<^enters. Children will be grouped from the age , 

of three on and there will be^no sudden entry into school. Most instruction 

, \ • . / 

will be individualized T?ith a continuous dfp^gnosis-prescription-evaluatiqh 

cycle so that the student can g£?th^ mastery of basic skills as etfficient^y a^^ 

possible. Learning rtisource centeri£> with computerized libraries and communi- - 

cations controls will be the centers education just as tjhe library is the 

centej: of knowledge within our great universities. Study x:arrels or teaching 

terininals, however, will be remotely located for the convenience of students* 

The 'lock-step, self-contained classroom^wlll completely vanish* While we may 

still have lectures from distinguished speakers, the current classroom scheduling 

system and sequence- of courses on a semester\or quarter-basis will be .completely 

replaced 'as the uniformly prescribed curriculum disappears* Computers will take 

over most of the drudgery of scheduling diasses^^ allocating learning resources 

to individuals and groups, maintaining progress records while preserving their 



^confidentfaXlty ^^he^ providing elsy 

access to^ files of information for reference or guidance by students and teachers 
and » hojit '^f oth^r managenvenc activities* • ' {Holtzman] 



The problems of engineeriSg the transition fro. Uboratdry to production 
have only barely begun to be faced; the economies of scale necessary to bring 
costs within reason can be realized only through massive production and ' 
standardization; teaching Materials to be used with such systems exist only In 
'bits mi^leces; and the people capable of forwarding the state of .this are 

X -.^ r [Oettingerl 
woefully few. , - i » 



J 
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A brighter future for CAT might be established through aya^Wfshit) which 
includes industry, government and the .education prafessidn. '^dett^in cc.pani.s 
like hardware manufacturers „book 'companies, and computer) software houses 
must be Brought together in order to construct a viable m sV^tem. The. 
educaeional community must provide subject-matter experts. \de,|onstra.ion .and 
test facilities, and expli^it^goals. It; has traditionally ^ee resistant to 
outside change but achieving full value df CAl -involves comA,itment of dollar 
and. personnel resources for large-scale R&D effofts and for ^ssive training ^ 
and retraining in the educarional'.ommunlty. Tn. chntral P,c^mment is the 
on#partper that 'can adequately and properly provide the >||ding and -policy 
guidelines necessary-.^ the financial investment is considerable; the effort 
.ust serve the public welfare; and the ^^lum' on the investment may r^e much 
longer than industry, profit and loss statements demand, :/ , % " 

One method of implementing the proposed partnership isl to establish a 
national center for research and development on innovation , /in educational 
-systems, perhaps a non-profit corporation. The center's pkme function would 
be to coordinate the application of diverse scientific an^ technological J 
principles in the solution of educational problems. Research and dev^^ppinent^ 
^^d^^:^arri:ed- orraTOcal/^ns:tma^^^^^^^^ 
with feedback to the" center to upgrade the technology i^ general. A system 
of demonstration schools would be established ta'implen/ent and integrate the . 
R & D finding withi* practical costs, situations and Constraints , and to 
disseminate information In reconwendedchan^e^y (Seidel & Kop.telr.j 

* * _ 

Machine, decrease in coat as they «e produced; •arly models of «.y 

system are usuall)^ maximally priced because developmental expenses are 
included, rnis has been true of both. compu^S^ and television. However 
teachers' salaries follow the upward" spiral of the standard of living. From. 
^ the viewpoint of costs aLone ,.whei thV two Hnes^- teacfia^ and technology 
intersect in the future, teaching-by- technology % need to be considered in 
a riew<clght and jnay' be-ftSuhd to be iar more attractive a cost b-asTsTtKan 

. -^.floo*, Allen i HwAltonJ 

is toMn ' » 
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Educators will have a grea<' influence on the future of CAI, through their 
decisions abobt overall goals of education and about the technology requirements 
for reaching those goals. The focus on overall goals will yield a change in 
emphasis from method to specification of objectiveb, increaslnng the degree of 
measurement of the 'learning process. Such measuremept in itself will greatly 
increase the rate of innovation in education by making clear the additional 
work that is required. .Goals set for the learning process should also cause 
an expansion of education into other aspects of society, specifically, in the 
home and throughout a career. ' ' * '[Bacon] 
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II, Professional Staff Involved in Development of Learning Exercises 
A* Administrators . ' . 

B," Operations and Systems Staff 
C* Subject Experts and Teachers 
D* Evaluation Specialists ' 
E* Computer Scientists 

F* Educational Psychologists - • 

Learners 

III* Models for Instructional Design 

A. Need f or ^Exiflicit Models 

B. ' Usefulness of Detailed Prescriptions 

C. Contribution of Continuing Research 

D. Othes Considerations for Developing a Model 
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*These stat/ements have been selected froni published and unpublished literature 
to repreAt-^ario^s points o^ view concerning development of computer-abased - 
learning Lmnals. Most have been ^shortened and some altered to convey the 
intent in a few Unes within- the context of a larger outline, and to point 
out slmil'arltiea and; differences with related positions. ' • 

^ - s ' * ■ ■ " 
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D. Implications for Representations of Knowledge 

V. DocumentELtilon of Instructlooal Programs 
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1\ Modes of Computer Use in Instructional Programs 
<■ * 

A. Con siderations for Developing EffeetiVe'Uses of the Computer 

Effective curriculum development in^y sub^ject or group of 
, subjects requires an analysis of the content leading to a choice of 
appropriate methods, media and sequencing. Thus in planning a courfee, 
each unit of work should be seen as jiontnributing to_a fu^ly co-ordinated 
whole. In considering the potential rrffS o£ the computer an essential 
re^-req.uisl^ is a complete' analysis^of th.ejt3E5p&SH-d course content so 
tl^t computer facilities 'car be realistically . exploited as a contribution 
to the whole. ^ "1 



Kie' dssigner .of a coaputer-based siaoiatlon or gaaing 'exercise 
should give careful attention to specif iOnstruetional objectives and 
Co the contribution of computer aids to^ tteir achievement if^he hopes 
to doctmient his hypothesis that the richer envSranment and greater 
■responsiveness of. the computer lea d-tix - many-^ther desirable results 
in addition to acquisition 'of faets^nd-basie~skills which might be 
accomplished with directed study and ^tiS; " fZinn c] 



Potentially a very important educatlonsrute "of t'he computer's dpac^ty to 
handle data and to.gtore and retrieve inforaation is, the presentation of 
complex simulation which it would be difficult , impossible , too time- 
consuming^ or too costly to set up otherwisi. It becomes feasible to 
estend the student's experience beyond the toynds usually set by current 
educational techniques. [NCET] 
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For certain students and some instructional objectives the effectiveness 
of a computerized, author-controlled presentation will be sufficiently 
greater than experience wi th the same content in tExtbooks cr audiovisual 
? materials to justify the greater cost per un^t of. instruction. For 

r . ■ example, many children lack the verbal skills. fscriminations. and 

I attention span that may be needed for independent stud^ without the . ^ 

I aid of a computer; students of written and spoken languages ia any age 

I . • : group may for similar reasons need computer assistance for diagnostic 

I self- testing of ski} is. j 

I computer l.^nistered drill or practice h.^ particular- reWnoe to current n.eds 

I providing instruction for the disadvan^^ child. Gaps tn .chieveaent . 

I . between. populations of th. disadvantaged/ which are presently hampered by the 

1 traditional ed^ational program, an|ot^r chiidrea can be narrowed, although 

I the^technique may not prove of value U all individual cases. iPrince] 

I ^ • Although computerised dr-ill may be gc/od-for remedial students, motivation is 
the k^y issue and thechild might learn t,ore if he wrote his own programs, 
iearningwith the computer should be a creative experlehce, not a fully 
programmed exercise which decides everything for the. tudent. iLoo.i.J 
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B. The Computer as a Learning Tool 

A current trend In instructional use of computers is away from the programming ^ 
of sequences to be deliverefLhjLth^e computer under strict control of the author's 
sequencing .ules. Managers of future systems will probably make the primary - 
sources of 'knowledge directly available to students through organized files of 
information and procedures; students will be^iven the necessary learning tools 
for information management, computation, and composition. 

In using "tlie computer as a learning tool, students can accomplish more 
scholarly work\f greater quality during a given period of study and acquire more 
skill in searching for and organizing Information than through discontinuous \^ 
encounters with structured and strictly controlled tutorial instruction \ 
interspersed with periods of independent study. The development of curriculuA - 
files shifts the role of the subject expert from the detailed writing of a step- 
by-step introduction for a topic to the assembly of an appropriate data base for 
student exploration and to consultation on the development of powerful aids for 
exploration and scholarly work within those files of information. . [Zinn a] " 

One' of uh^i most useful modes of coaputer use for physics instruction is 
computation: the students use the computer as' a coaputer av d with a standard 
programming language. Courses will be restructured to take advantage of this 
new and powerful tool. Too often people ignore this particular usage even 
though in some areas, particularly in the sciences, it seems to have more immediate 
potentiality than almost'Tagy other way of using computers. [Bork] • 



It is doubtful that CAI programs which look like lectures and programmed . 
instruction ^texts could show significant gains in either time or achievement 
to justify the choice of CAI over paper-and-pencil or cheaper audio-visu*l 

tB"^i^*r8on] 
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In educattoaal activities should- thk compi?^''er contirol the cliild, or. the . ^ 
child the computer?* School boards ' and o^her public officials should insist 
on computer systems that prpvide each s/udent with the cliance to develop 
some minimum programming skoil.. The ^iture citizen will- be -much better^off^- 
in the age of tha computer if I e*lea|^s at an .early age that he^can^^nd,^^ 

- — "{Science Research! 
control the computer. , f 



C. Computer Aids f or^nstn trtlonal Management 

When individualo are pemitted to learn at their, own .rate, enormous differences 
in the timfe required to achieve certain performance standards are soon evident.^ 
As a result, practitioners in individualized instructional programs report that 
the instructors and aides become inundated wUh record-keeping activities. The 
ne.d for a computerized man^nt syste. .is obvious in these setting.. [Dick]" 

A core recent trend in ins tructlonal application of the computer is c<»puter- 
^naged instruction. Though there are several projects currently in progress 
.cr one of them is far enough along to per.it evaluation of this approach. nee 
the principal function of .he computer in GMI is to^re.cribe and schedu e i 
could serve thousands of students daily.- and the operational costs should be less 



than those of traditional instruction. 



[Morgan] 
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II. PROFESSIONAL-STAFF INVOLVED IN DEVELOPI-IENT OF LEARNING EXERCISES 

* 

Various types of professionals are neede'd to make up the staff of a computer- 
based learning project. Many of these personnel will be specially trained in 
the new technology; others have managed to adapt their skills to meet new 
demands. A number of individuals must work together in order to develop 
effective uses of the computer in education. [CLUE Staff]^ 

A. Administrators 

Here are needed educator-businessman types literate in computer lore. Also, 

thereat be a higher management which encourages an environment for continuous 

progress (self -paced) learning in other aspects of the educational or. training , 

system as well as CAI components. - [Bunderson] 

• t 

An administration sympathetic to .the goals and knowledgeable about- the costs 
and other demands of careful development is essential to success. Furthermore,^ 
enthusiastic administrators sometimes carry along an already overworked staff 
when funds, computer resources, anrf personnel are otherwise lacking. 

[CLUE Staff] 

. , / ■ ' 

B, Operations and Systems Staff 

This group includes a supervisor, operators, system programmers, and proctors 

- ^ . , [Bunderson] 
for terminals, >^ 

Operation of an' Instructional resource is a peculiar task. Nevertheless the 
experience gaiaed fro« struggling to ««et vc/ied needs *t some other resource 

a A 1. (CLUE Staff] 

center is invaXuable. 
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C. Subject Experts and Teachers 

One needs excellent, talented scholars who can assist in the task analysis. 
These content scholars witl find themselves interacting primarily with the 
behavioral scientists, associated with the project, [Hansen] 

V • • 

Teamwork between scholcyr-teachers and CAI specialists will be required. The 
former will confirm the analysis, suggest and develop the major representations, 
and author the basic steps of the program* , , [Bunderson] 

Suitable networks will stimulate and assist groups of subject experts who work 
together on computer-based materials for the same course at different schools* 
Materials developed on a cooperative basis will be more usable at different 
institutions than if they were developed independently. [Zinn] 

Curricu im development of all kinds requires the active collaboration of 
teachers and lecturers in the f ieLd^ Teachers must explore and exploit- the 
possibilities of the computer for /it will be only through them that effective 
innovation c^n take place, [NCETJ 

B, Evaluation Specialir*t3 

The techniques for assessment of outcomes, especially for feedback on 

effectiveness of material during the develop«ent process, are Involved 

» - ^ / _ 

and require experienced personnel* fGLUl Staff] 



In summary, the functional skills required Ire the result of backgrounds in 
educational psychology, experimental design and statistics, author-teacher 
experience*. Instructional programming. Instructional coding, familiarity 
with computer assembly languages, computer operation^ adMnistrative 
cootdination, and supervision. A team is needed to make efficient use of 
a system, and would be adequate to handle several subjedt^^matter experts, 
each of whom must have sufficient ability talent and expertise in his field 
to warrant the expenditure of time and effort* 
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E. Computer scientist s. 

The cross-fertilization between system analysis and computer programming 
.and curriculum design for CAI may yet produce a decisive advance in education 
just as mental cross-fertilization between different disciplines has contributed 
to all decisive advances in the history of scientific thought. [Bunderion] 

p. Educational psychologists 



Instructional designers will help by suggesting representational ideas appropriate 
to the interface, prompting with heuristie questions suggested by the design 
models developing system architecture in close cooperation with the authors, 
filling in details, and supervising the coding, media preparation, and program 
documentation and maintenance. ^ [Bunderson] 

Learning systems analysts should be members of a team working- with subject 
experts and able to gaii/Tqb^xk liderstanding of the subject r identify flaws 
in -reasoning of logical -^esentHl on; dete rmine for spec ific skills whether 
current methods are the blst available; Rfe^ribe a ske] eton form for. the 
material; play! the role of a student; decide^on the most suitable mode for 
presentation media; turn analyses and prescriptions into working program*. 

IHCET] 

Learners 

Although initially considerable weight should be given to the opinion of 
experts In the subject area, eventually simulati^n^uses of computers for 
instruction should be submitted^ as are other uses, to a careful analysis 
atid evaluation in terms of learner performance and attitude. (Zinn c] 

Uses of an interactive language make the program more accessible to the 
student, increasing the opportunity for him to become involved in the 
redesign of an exercise. This Is «sp#cialLy i«port&nt wh«a the curriculum^ 
witer has Incorporated nathsMticsl models or similationi. [Zlnn a|l ^ 
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III^ MODELS FOR INSTRUCTIOML DESIGN 



A. Need for Ex plicit Models 



Models must be explicit if we are to. make progress toward a technology of , 

[Zinn 

instruction. ■ .- % 



[Zinn a] 



A more effective and economical generative teaching system canj>e developed by 
establishing an explicit model of the human tuto^who_operates in a generative, 
algorithmic or creative fashion and then simulating these operations. [Uttal] 

,.&ne of the major probl^s with instructional strategy is the lack' of prescriptions 
^for instructional design.. There is no adequate data hde from.which to derive 
prescriptions in ^ny one curriculum area, and no generally useful prescriptive^ 
rules are found in instructional theory. [Zinn 



Certain professors highly regarded i. their fields appear-to ^e m .r . prnduc ti3^a. 
without the constraints of an explicit model for Instructional design although 
their consistent performance suggests some implici1:%odel. [Zinn c] 



B. Usefulness of Detailed Pres criptions ■ i 

Things to be Teamed from the original notions- of programmed ^^-^ 
instruction include: (a) the sequencing. pf events to set up the" 
increasingly pre,clse forms of response defined as subject-matter competence; 
(bj/the significant process of the Sequencing of instruction to establish 

Id transfer stimulus control (the expert in a subject-matter makes 
p^^se responses to fine des criminations, and he is, in this sense, 
nmchioreNitt<^^ the coni;r^l of the nuances of his subject matter than 
is the^Vic^^K^d (c) sequences which involve the systematic withdrawal, 
of £lie leariiing'^pports required by the novice so that the. behavior of • ; 
the expert becomes i^reasingl; -self-sustaining and is 'maintained. for long - 
'* periods of til* withou^^>l»« external .uptK>rt of .id. «id references required 

[Glaser] 

by the novice. , • . 
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^1. ^' 



In order tq achieve the benefits of separating procedure from 
content, the empirical derivation of practical strategy should be of 
considerable interest to educational psychologists. Given a set of 
techniques which work, and some parameters for adjusting or tuAing them 
to individual prob<lems and students, the educational researcher has a 
much more powerful tool for conducting research. [Zinn b] 



Ti 



C. Contribution of Continuing Research 

The existence of individual differences (learning styles) and kinds / 
of instructional sequences which must be designed for, them can be discovered 



O 



on the bftis of CAI experience; but only if instructional sequences ar^ 
set up in an experimental enough fashion to allow these differences to' 
en^rge. [Glaser] 



/ 



» _______ ~ * ' -- - 

Many interesting aspects o.f an instruction strategy may be hidden 
Tin" iKe-impircrt Wde rs taMiSg^^hiiman may have concerning tlie subject 
area and s'tudent characteristics. Requiring materials and strategy to be 
developed through the filter of a programming language assures that procedures 
will be explicit/ [Zinn n'l ' ( - t ' 

One of the majoc pi?bblems witb-instructional strategy is the'lack ^ 
of prescrip_tions~fbr 4nstru^^^^ design; Perhaps there is sdme hope in 
tl/e additional power provided by generative techniques, since designers 
will be laore likely to identify and manipulate significant paramaters* 

[Glaser] 

One major problm with striving- for learner achievement and. efficiency, is the 
lack of suitable units fdr measuring competency in a subject area. When the 
major purpose Is to determine the relktive st^tading of students, units need 
not be an important consideration. However, a report on the efficiency of a 
strategy or medium of presentation should try to say that so many units of 
coi^tency imre acquired >«r unit ti««, (Zinn bj 
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€) An ^structional design model should provide a context fof"basic and applied 
research, generate questions, and. of fer an Incentive for researchers to seek 
to develop answers to research questions in a mariner which can translate to ^ 
instructional design practice in actual curriculum projects. ^' [Bundersonl 

0. Other Considerations for Deve loping a Model 

Psychological models' provide a framework for research on instruction, but are 
■ relatively sparse. in content and lacking almost eyxtirely in prescription when 
compared to human insight based on considerable experience in supervising 
individual and group learning experiences. Among CAI researchers, Stolurow and 
Bunderson have done more than most using models, and both have at times spoken 
enthusiastJ^caily. about prescribing different treatments (curriculum tracks or 
sequencing techniques) for individuals of differing characteristics or performance. 
Howtver, neither can demonstrate success in such prescriptions, and thef prospects 
, . are-3^s-enxro«r^glti4. now than they were five years ago. The problem might l,e^.^ 
characterized as having to know more about the learner and his study skills^than 
O he knows about himself, ^or applying computer control techniques to learners who 

are unal)le or unwilling to use the iniormation about the subject matter organization 
' • and their own progress which Is iprovided by any reasonable supervisor of a self- 
instruction enviTonaent. 
m the .bsence of hot knowing «ore about thr learner than he knows about 
himself, an alternative ?lan is to grant to the learner the freedom to ^ 
organize his way through "knowledge spaces" and let the computer track . 
him. The operational routes through the courst, as supplied by the 
computer, will greatly aid educational researchers In developing such a 
theory of iiistruction. In. addition, it makes learners responsible for their 
own actions and mahag^ment ot learning, which is almost totally lacking in 
educational systems of today. 

[Grubbl 

* . - 

It is not to be implied that cecKniques of research and development in 
behaviotal sciences have mot benef ited J.n8tructipnal ^echnology ; rather, we 
. . have derived ak a result better tools and methods f or ^development, presentation , 
. O . an<i evaluation of learning exercises lwhether computer-i,a8ed or otherwise), 

Neverthelew, ve hav^^iirdy esprllcal t<H:h?^Si^««;^tt^^ ^••^^^ / 

or;:o£i in»tru^tioir-to put 
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It may not be wise to make a stronger statement about using mathematical 
(or information processing) models in a computer-based system today. The 
aspirations of early workers (Smallwood, Atkinson, and Matheson for axample) 
have not been realized at least in practical terms. However, the nature of the 
'automated system (large memory, detailed performance data.^and rapid processing 
of logical and /or -mathematical relationships) is better suited to mathematical, 
logical, and structural approaches than to descriptive or heuristic ones.^ 

Although it must be an over-simplification of the contributions of the 
two classes of models, it is recommended that behavioral-science models be 
applied to the human components of a computer-basea instruction system, e.g., 
orienting the teacher, counselor,. and, manager to the individual resources and 
requirements of lea'rners. Information-science models should be appliefi to the 
machine components.' e.g.. arranging the information in a wa|- accessible to the 
learner via the system and ^ding the feedback inforraatibn ^nH control mechanisms. 

* [CLUE Staff] 



- ■ / 
A. TasW Analysis 



IV. AHALYTIC TECHNIQUES 



Task analysis should tell what needs to be taught in subject-matter terns as well 
as identify the kind of behavior involved, - . [Glaser] 

A task analysis of the curriculum concepts to be taught to tha student shoyld be ^ 
performed. In simple terms, the task analysis should reveal an outline of the 
curriculum structure as it is to be taught. [Hansen] 
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B. I nitial State of Knowledge and Skills 

Entry behaviors are the skills and knowledge which have already been attained 
(bj the students for whom the Instruction is intended) that are relevant to 
the task which is to be taught. They describe where the students are now* 

[Dick] 

The informatioh about the task and about the /Studen t^s entry skills should b€ 
taken into consideration in order to formulate the behavioral objectives. In 
fact, task analysis and entry behaviors are the primary determiners of behavioral 
objectives. [Hansen]^ 

Entry behaviors should indicate where the students are at the. beginning of the 
course, and the task analysis should cliaracterize the various conceptual topics 
to be mastered by^the students, [Hansen] 

C. Hierarchies of Knowledge and Learnin g Tasks 

Th hierarchy fonts the b«»i« for the design of individualization and its 
description in flow chart form. The list of objectives is the basis for the 
specification of interface requirements, the diagnostic and curriculum-imbedded 
tests, and the terming parts of the sequence of steps for each sub-objective. 

" » , I Bunder soii] 

The behavioral objectives should be structured within a sequence which reflects 
one's pedagogical strategy. The instructional strategy to be employed should 
relate to a hypothesized set of psychological states through which the student 
would pass. , . [Hansen] 

With respect to individualization of Instruction, a hierarchical analysis 
provide* « good map on which an Individuai atudent My be located. [Glaaerl 
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The hierarchical analysis procedure seems readily applicable to any cumulative 
subject matter like mathematics, much of science, and even music. It seems 



xess applicable in highly verbal areas* 
D. Implications for Representation of Knowledge 



/ [Bunderson] 



Empirical data obtained from/ learnings hierarchies might influence^ the way in 
which knowledge structure has, heretofore, been represented • [Glaset] 

In sum. the student taking this codrse soon .realises that he is like a man 

1 ^ ^ 

using a motion picture-vcamera equipped with zoom,, pan and ^It features. 

Successive stages of i/agrilf icatS^ of the subject expose moYe and more 

details while panning and tiltingvkeep- thp structure and perspective intact 

at all times. ..Symbols attached to^* each nap InfTorm the student of the 

level of magnification. [Grubb]r \ 



V. - Documentation of Instructional Programs 

Readable descriptions o'f content and sj^rategy -are essent al to economical * 
maintenance and effective use of computer-based learning materials. Widely 
adopted guidelines for documentation will broaden the base of users^of. 
effective instructional programs* (See Part 7 /and Appendix C of this 
volume.) ^ / ^ ^ * 
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VI. A. VIEW OF THE FUTURE 



It is likely thkt by the early 1970* s the simpier forms of CAI will be In full 
operation in many schools. 'Xhe more highly enriched tutorial CAI will spread 
more slowly lai;gely because of the amount of effort n^ede^' t^ develop It properly 
and the relatively high cost of implementation. BM^^^^ld-.i970's, however, it 
should also be fairly' coitoonplace in settlngsj^Jief^he effectiveness offset^ 

^. ^ .--'^ i fHoltzm^l 

the cost. - . ■ . \ 

The first succ^psful appilca|;ionw» h'road basis o£ computer-assisted instruction 
at the tutorial! lev^l jwillprobably be'-at the, secc^ndary and coTicge level of • 
.elementary 'forllgli-language teaching. / ' [Suppesi 

The development of a free-choice delivery systen for CAI, particularly into the 
home, will Ipso facto free'learne.rs, <5f all ages. 'frDm the institutional 
rtequirements. of conventional educational, ins titwtions. As a .consequence of such 
a free-choice development, inos£ educational Ins titut tons will eventually change 
'to b'ecomemore Responsive to those they serve or .wither away. . * 

Thu . CAT has the potential of being a major llbergi:lrtg factor in 
'education, "as such, it will/not be unique.: Technology certainly is a double- 
e^gfed sword; in additlon^to the constrictions it places on our lives, it can 

" * ' ' ' f Kvlel 

greatly increase our freedom. ^ ; , ^ 



computer and "informatton- skences. will provide, eventually^ "artificial . 

intelligence" to be. applied tin the teaching-learning process . ^ The resulting 
systems will serv.e tfoth the sfcholar aSx an author and ;the learned as ^ scholar. . 
whatever the discipline of study. . • " . f CLUE staff J 



, s 
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. / ■ • ■ 
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I.. ASSESSMENT OF A LANGUAGE AND SYSTEM 

A. Renr PSf^ntatlon^ inr Language «nri System Characteristics 
— T ^ # • 

The forced juxtaposition of two or more languages, whether list of aspects, 

characteristic" samples or measbres cf author performance and satisfaction, cannot 
help but encourage each designer to improve the capabilities of his iangaage at , ^ 
least for those .purposes represented in the comparison. , i 

J . Functional aspects compared against a standard list 

The comparison of languages by the 60 "common aspects" in the Educom comparative 
study emphasized similarities bx presenting together the way in ..-hich 40 different 
languages would be used to accoi^pllsh the s^e function. Such dlscosslon prompted 
■ some' language designers to fill-in a. few blanks in the columns describing their ■ 
languagesi that il; they added to their own language some of the ca?abllitle|_^^ 
previously (described only for otljer languages in the comparison table.--- ^ 

A summary table arranged -by common, aspects c^ot be Complete and tree of error: 
the languages are changing rapldl^i th^'^d^^ers axe slow toV^^^e cucrentr— - 
documentition; first-hand programming experience in each language: is kot possible. 
Different approaches to summarization favor one language or another; and more ^ 
important, different approaches to instructional use of computers requi^re essentially 
different language characteristics. . 

Languages explicitly intended to' serve different instructional, prograiming tasks 
should be described for the purpose of comparison by different sets of attrlbutjs in 
different tables. * 

In other words, programmlog t^lV should be grouped' with othe.s of similar purpose 
when mskiog relative compaf^ons, rath^r^than ^■ - uD^-^her with all the tools 
of very mixed purposes. 
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When making decisions about languages and systems, the relative 'weighting of various 
criteria must be determined by each project or user, considering: a) the age 

and background of the student or 6ther users; b) the' relative importance of research, 
development, implementaUon and operations; c) the relative interests of project 
staff in general" system characteristics, programming languages, or instructional 
materials; and d) the availability of funds and of a general-purpose system. 

Some gtandard fov^it or common notation is needed for wrl.ting an individualized 
description of each language so that its characteristics can be interpreted readily 
by interested persons whc did not participate in design of the language. In order 
to communicate with potential users of, computer-based systems, a notation for 
description should be readily interpreted by those who have little experience with 
languages and systems. 

2. Samples of code, presumably typical of user and task requirements ^ ^ 

me best test of a programming language is throu^^6, and the closest approximation 
for a reader not yet familiar with the language is a sample of use .on standard .tesU 



situat >ns. 



Each language has v^4ue feature-, and any small number of test programs will favor 
one or^anorher. It is difficult to represent the capabilities of any language in 
a few pages of sample prpgramsi . , 



Many of the languages continue to be changed, and the samples obtaineci one month 
may not be characteristic of what is -Ueing done with..xhe language six monjs later. 



3-. Empirical measures of usefulness: programming time, errors, aftitude, executfm 
time, etc. 
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Efficiericy of a language sometimes is measured by the number of machine language 
iivstructions, source language instructions, characters iv, the file, etc. However 
this measure depends on the instructional strategy employed, the propensity of the 
author for writing the same learning task description in a smaller number of 
instructions, and his concern for providing responses for a number of rather unlikely 
eventualities. 

" ' I ' . ' ' ' - 

A major problem fox evaluation of any co«ponent of «n instructional system is* the 

defiinition of a measure of accomplishment whicn avoids reliance on how long the* 

student spends with the new learning materials. The productiveness of an author 

should be measured by^ncepts acquired bjr^ the .student (or skills perfected), rather 

than by hours the, stuaenVspends at a terminal, as If the system we\e babysitting. 



An effective system will ^encourage curriculum designers to exploit the Computer 
medium to improve and expand tha^ content' and skills taught, and to use tfte'^obcasion 
of revision to * drop some material, which is obviously useltiss. " ^' . 

Criteria for judgments abou*: languages should be more ^xplicitt Words such as 

reliability and flexibility are used as if everyone agreed on what they mean*; in 

fact very^ different measures of the. implied concept have been employed* It. is not 

necessary that all writers .agree upon any single definition for a term or a unique 

measure for a criterion, but each writer should makcv* his use of tertcs and measures 

more explicit. ^ ^ 
/ ■ . 

* 

Journals^ phould adopt a firm^l[ijtrtoriai-p<?llcy which requires clarlfic^ation of the 
referent .or -measure of "power**, "elegante'% ^and other such terms when used in 
published reports. * ^ - , 
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b/ ^iiiiamui^a^^ C imaidaxiiig^>grn^ >ii^ aP4 Goals 

user perfonnance (e.g., error rate) is an important consideration in the selection 
i6r design) of a language. Increased training .ay not be the solution; progrannning 
Ws which appear frequently in instructional programs can be reduced by changes 
in th^translator. , , . 

oh. should^al^ays bf^rS^er fo'r procrannning errors but look s.t factors 
in ■"reliability" of^he semantics and syntax of the language.. The same applies ' 
to reliabUi'Cy of' the instructional program. Son^e of the errors which may occur 
during instruction and interfere with learning by an individual student shoula be 
blamed on the author, or the language designer, etc.. not: on the student. 

1. -Student . \ 

students need to "be able to get information about the systei. operation and procedures 
at any time: Is it o^eratinfe? Why was his message notiaccepted? How long might 
he. have to wait before starting a certain exerciW:-. Procedures should be simple, 
including conventions for erasure within a message or cknceilation of entire blocks, 
indication of availability of a device for input, etc. 

The student of a particular discipline shoul^. not haw to Require computer skillf 
and conventions which are unnecessa*ry ^or his study, e.g., complicated keyboard 
skins or n$w no tational" conventions unrelated to the subject of study, and necessary 
only to reply to a computer tutor • 

The infomation processing capability of the r.or^uter 'should be as available to 

the student as it is tc.tffe lesson designer or the reseaT<*er. 

% , 

Cojnputers and programming are now becoming part of ever:/day life, and the designer 
jf a computer-based lesson should not hesitate to require of th«^- learner certain 
" coiaputer skills otherwise iinreleted to 'learjvJ.ng in tb.st '^i^pct srfta. 
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2. Instructor (supervisor or manager of learning)' . 

The system (^nd Unguagel should Accommodate the instructor , to^the extent ^ 
that he ts expected to adapt the learning oatei-ial^ for each group of students 
and hia particular style of teachin&t 

^ * 

The right data on student performance and attitude should be available to the 
instructor' at the -ight time and" in the right context; relevant, timely and 
, interpretable information is ecsential for effective management of leamfpg. , 

If the system is. designed to run without intervention of classroom teachers or 
other supervisors; then computer memory space and processing time should not be 
wasted on f eat^jre. inc ' uded only for these personnel who do not use the system^ 
i« operation. 

3: Counselor or administrator, if different from the instructor 

Management working from a perspective different from that of the teacher may 
reauir. data in a somewhat diflerent format and context: the counselor needs detail . 

on individuals ^d in the context of other work o. plans of that individual; the 
. adminiatrator needs detail on use of resources (personal and technical) in the 
"^context of the total instructional system. 

M on-line data management system for school records would more than pay for 
Itself in saving administrative tii.e and |ducing errors in quick iudgments. 

Most of -the decisions which' are made in elcational systems do not justify on-demand 
access to current d^ta; decision points can be anticipated, and many of them are 
periodic. 
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4. Author or lesson designer . , ^ ^ 

staff on a currlculu. development project .e,vdre, .onvenienoe 
operation for writing and te^tln, e.erclaes, these requirements .ay 
the economy and convenience required for day-to-day atudent use In the ,ch„ol,. 
filial devices provided authors a^ more expensive, the speed of compilation of 
■new programs Is more rapid, priority Is g.ven to revision of materials, etc. 

> l = o^^na Pxercises may be selected and arranged 
Data obtainable from student use of learning exercises may 

^ ^ «f tho exercise (by the author) than xt 
differently for the purpose of revision of the exercise ^ Y 

would be for assessment of student performance (by the teacher or administrator.) 

system designers should leave many options for the; author. As a^.es: the user 
^y prefer off-line to on-Une entry with l^edlate diagnostic.; he m.y wish to 
ZLs. some of his own notatlonal conventions rather than always to adop those 
of the sys Im progrs^er who designed the language, he may wish to *ange ^e 
standard JpUes (such as from 'Vrong. try again" to "not — J' 
'or^to adjust the tolerance for accepting misspellings or typographical errors 
Otherwise correct answers. , ^ ^ 



Anhough there are many tri -s that can he playe. *lth-the. .^™ter registers an . 
character registers of "author" languages, the lesson designer must apply pecul ar 
co^ands for manipulating these rudimentary elements of informatior ;>--"^;« 
computer. Playing these g«es will distract otherwise effective authors from thelr^ 
primary purpose: helping learners, m some ,fflcient fashion. 

A procedure for presenting curriculum materials -should be prepared by expert 
progrs^ers accordi-Tg Resign developed ty a team of subject experts an . 
educational technologist, /then the writers .nter material Into a system which In 
part can proteci them against their own errors. 

- / ■ ■ 
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5* Researcher on instruct' and learning 

Ax educational researcher is willing to pay much more per .terminal hour than an . 
educational administrator, if the system provides the required facility- for stimulus 
presentation and data recording, 

*^ 

Research uses usually require more detailed data than teaching and curriculum 
development, and some data are unrelated to teaching purposes: latency, physiological 
measures, etc. ' * ' 

In some research uses the computer makes no contribution to'leaming by the 
subject during* the experiment; the researcher need not be concerned about computer-base 
instruction contributing in some way' to the^ learning of the student beyond what 
would have been achieved without the computer. ' ♦ 



6. • Researcher on the systems and information sciences 

A project on language characteristics and system features must invest in 
flexibility^ even at the expense of author ov studerit convenience. ^^The curriculum » 
writers who choose to work with such a project ^ust be willing to give up convenience 
for the sake of experimer cation, e.g;, adjust to lansuage changes, accept errors 
and unreliability, and modify or discard outdated programs. / 

An experlmatital systm may be entirely different from an operational one ^rith ^ 
respect to relative jcosts^ reaponaivetiesa to dififer^t uaere, etc. 

Some day' the;exptrimental and -operational purposes can be brought cogether in 
the same system. . . ' * 



/ 
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1. Routinized drill and testing 



A system used foY'driU and /estitlg sho.uld have a library of Standard routines 
which can be adapted for whatever pool of drill or test items the user might like 
to introduce into the systep. - . 



A user should be ^hle to 4kd rfeadily to the library of rourines or procedures 



"for drill and testing. 

■ .i ^ ^ . 

The. description of data [tes^t items) for standardized routiixeu should be 
straightforward aid convenient for the^ author. . * 

■ • ■ .. ■ - 

2. Computerized programnied'-ins.tructioa j 

A system used for presentatW of programmed instruction materials should ^ot 
require of Ih. autho( much mo^ than a. sp^ecification of the text materials as 
they might be presented in booklet form father than on the computer. 

<^ ' . " • j 

^ VTien varletv is, required it should be introduced at random or according to . 

paraa^ters 4der the author's ^o^trol. e.g.. selection from a set of 9onfirmatory 
replies or options to introducfe-review material. ^ 

* Frame-by-frame' writing .of programs vith an^^uthor language is. on the way out. 
A 'few years from .now less than one tenth of any computer-based course will be 
programmed by an author or his technicar-assistmjt frame by frame in 'languages 
such as'CdURSEWRITER and PLANIT. 



1 , 
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i 

3. Diagnosis and. remediation 



-A system intehdadj to previde attention tq difficulties of Individual learners 
must have some geiterallzed procedures to apply each time an answer is incorrect; 
full programming pf each frame of a diagnostic test for" all possible studel 
difficulties is not feasible f^r the major part of self-testing and remediation 
exercises'. I . • • i 



Diagnosis, and remediation are. important uses for computers in insi;ruction, 
for the student, ils likely to benefit gr^tly from thd" opportunity -Po-r intej^tcfcion^ 
with a prepared! |!r,c/cedure. This mode of use places correspondingly greater deoands 



on the programm^g language employed, 

/ ' V . ■ ■ . ■ ' ' ■ - . , 

Standardize/l^eprning- materials can be presented, effectively by other aedfa than 
computer-^^sed-^ystecis. The fflore expensive inforwotion processing deyic'es ^d , 
tpiV'grarntnj^g lanbages snould be applied to those situations*' such.as re«aediation 
where individualization is not only - desirable but* necessary. 

• ■ / * 

4. Question 'ansWesrihg ^ ' 

Being a device for storing, processing and feLrievlng informitifi;s, the computer 
shoufd be progr'antmed' to assist the individual leame if ^in his M scholarly endeavors; 
by providing answers to questions about information sources, facts, ete. 



One general approach must be applied to many topics anil. learning exercises if 
■expensive question"*answexing systems are to be practical* ^ ^ . 

The ejcpensive' systems, designed to \e9J?ond to inputs, of great^vpijety an4 be^ 
applied to. a wide range of topic,-*, become practical when the flel4 of inquiry 
and fhe format for qu^festionirig are suitably restricted. 
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5. File and text manipulation 

Handling files and string^ of text is not a process incidental to computation, 
but a substantial part of information processing sciences. In the educational- 
setting this mode of use should be accorded full attention in the library of 
programming languages made available. 

'\ 

The lesson designer (or the student as a direct user of file information) should 
notTiave to [nanipulate ^textual information with primitives applied only to 
characters and linds. Languages should allow suitable representation for units 
such as words, sentences, paragraph?^ ^and chapters a. *11, and for search and 
transformation operations. 

6. Numerical problem solving 

k conversatiqnal problem-solving language such as APL, BASIC, or CALCTRAN would 
be much more succesSul on a regional computing service than an author language 
like Coursewrirer. The development of high-quality^ tutorial instruction requires 
a major commitment of funds and personnel, including instructional designers, 
media specialists, and programmers not usually available' at remote locations. 
Typically, one person at a site, almost never on .a fiill-time basis, must give 
demonstrations, teach- programming and consult on applications. An interactive 
computing language can be more easily taught and more effectively used with limited 
resources. 



The problem-solving mode will be over-valued and misapplied, as was COURSEWRITER 
five years ago. However, more instructional materials/ of significance are likely 
to survive in this m9de in the next five years than. Have been seen in the 
computerization of programmed instruction in the last ^ive years. 

■ \ 
. \ 
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Undiirected use of a simple progfoiraning language , is not always a cost-effective 
way to develop skills in problem solving or conceptualization of procedures. The 
.designer of a learning' eArcise or environment must consider adding language 
features specific to the tasks the learner is to carry out, and try to describe 
ways of assessing the learner's progress along any path to a solution, perhaps 
specifying interruptions to provide information about difficulties encountered. 

The special contributions of interactive mode of uSM,to studenc programming and 
problem solving are not obvious. Much of what is said to be unique to interactive , 
processors can also be accomplished with weil-conceiyed compilers in a system 
^provxding' very quick batch response. [See VI below on interactive mode contributions.] 



7. - Graphic display 



Although graphic capability is much sought After by many computer users presently 
restricted to alphanumeric displays, those who do have the technical capability 
to show the student" line drawings and accept simple sketches in return find the 
associated programming task horrendous. Programming problems in this domain have 
not been* solved for instructional users. 

8. Other modes not defined (i.e.. grow'^th potential to meet unanticipated user needs) 

• ^ 

Other modes of use may not be included in the listing above, and many new uses 
are yet to be contrived. Each 'places special demands on the programming language 
and system which 'should be met if teaching and learning are to proceed in an ^ 
■efficient and effective way. Computers and information processing should be at 
the disposal of the learner and others in the educational system, and progrkuning 
languages should be adapted to their purposes. 
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No language can be expected to have all those features which may be desired by 
various users^ * Most languages provide for. definition of 

subroutines (separate routines designed for repeated use) with a transfer statement 
which saves the present location (or any desiguatgd location) so that control 
can later return to one of the saved locations. Macros provide another way to 
avoid repetition in ct)ding by packaging a number of statements to be called on 
by one statement, in some cases with, parameters. The facility for adding new 
operations or statements is less common but potentially very significant. 

Some languages allow the programmer to write special functions, perhaps in another 
language, with a list of 'arguments automatically transferred from one to another. 
Ideally, programs written in any other language could be linked to an instructional 
program so that data could be fTassed from one to the other when the student moves 
from one to another (e.g.,^'from tutorial to a special simulation or^odel building 
package)., . • \ 



\ 



D. Suitability, for the Style of Proj^ram Preparation \ 



\ 



If the programming language capabiliti^g^?^and oonveirtions are not matched to the 
instructional programming task, exploration of new curriculum objectives and 
learning techniques will be suppressed, and large scale development of materials 
Willi be discouraged. ^ 



1 . ! Description of successive frames or items 

Moife instructional programming has been done by^' preparation of frames than any 
otller approach, and most special-purpose "author'Manguages provide well for this 
style. However, additional provisions for establishing normal modes of operation 

calling on standardized procedures would reduce unnecessary repetition in the 
instructional programmer's task. ^ 



I 
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The most strat-ghtforvard approach to serving the needs of an author may be to 
provide a format into which he places elements of the curriculum. The computer 
program successively presents the question frames, provides a hint when the student 
asks^ for it, provides the right answer when needed, and records performance data 
for later inspection by tUe author of the exercise. 

Frames of instruction or items of tests, can be adapted as a kind of computerized 
programmed instruction. The similarity of the cade and conversation to a programmed 
text i3 apparent. In fact, transla^tors have been written to accept linear (or 
simple branching) programmed text and derive CAT interaction with a student. 

2. Provision for conversation within a limited context 

Authors sjiould be able 4;o^ compose complex, conditional' procedures jnore easily 
than at present; MENTOR, and PLANIT incfuBe good examples of convenient conditional 
expressions by which a procedure can be made dependent on student performance. 
Most authors of computer-based instruction have ma^e little use of computer logic 
and memory, perhaps because they are unable to conceptualize complicated sequencing 
rules, or because they are quickly discouraged from doing so by the" clumsy syntax 
of programming languages' prepared for them. 

Programming for conversation in relatively unconstrained English may not be a 
reasonable approach until some break t hrough in research on"^ p rocessing natural 



language provides an. efficient and reliable means for "understanding" or at least 
classifying //hat the student says. 4 

3. Description of a standard procedure by wh^.ch material is presented 

Content should be prepared in a form independent of particular computer conventions 
and convenient from the viewpoint of a context specialist. The .control procedure 
which administers a learning task should be free of specific content material. 
The answer processing and other conversation-handling aspects of control should 
be separate from the scoring and sequencing algorithms. 
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Computer programs which assemble instruction materials from elements of the 
subject matter and relationships among those elements should permit the author, 
to describe an fe,ntire class of problems by one set of statements. From one general 
de^scription, an indefinite -ntjmber of test or instruction items should be generated 
for presentationi^fio each student as needed. A procedure which assembles or generates 
materials is likely 1:0 have more possibilities 'of adapting to the individual than 
one which selects successively or, branches through a large pool of specific items. 

Increased use -of procedure-statements and (separate) curriculum files will be 
beneficial for the field, and increasing use of computers in large curriculum 

r 

projects will require "this approach for economy. » 

Procedure-oriented languages are for computer programmers and for educational 
trechnologists specializing in computer applications; these persons should produce 

the u^er-orientei languages or data formats which maximize convenience of the 

V ^ ^ ^ * \ ^ 

curriculum expert), 

/ . \ * ^ 

ydne' could have too large a library o^strategies and too much indi^duality among 
students and topics Vor standardized techniques to be useful* 

• \ 

Until instructional olyectfves for a topic are rather well defined (for 
example by standard procedures for t««tiag use of facts, concepts and simple 
^feil4s)-,--deve4opment— of-^pr^cr-iptlv*-xurriculu» for dndi v i du al i zei instruc tioii__ ' _ 
in that topic is not likely to be succ«s»fid. 

The practical application of standard procedure programs and generative techniques 
applied to .curriculum files on any specific subject area or training situation . 
raises many questions: How are ^information structures to be described by the 
stabject expert and stored in the computer for use in such procedure statements? 
How are materials to be; assembled according to general rules? How is input from 
the student to be processed in some general way which determines a siiitable reply? 
Can patterns or sequences be identified which prescribe certain adjustment for 
the student on- succeeding learning experiences? Can the program improve itself? 

. 5 ... 
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4. Specification of an environment for programming and problem solving 

If an on-line problem colving language is suitable for. simulation and model 
building, then that lai>guage certainly is of interest to designers of computer-based 
learning environments. First, the subject expert may build models on which to base 
games or simulated practice for students to try* Second, he may guide some students 
through revision of the models and construction of new ones. In general, he wants 
to show students how to use the computer for information processing in his discipline; 
as lesson designer^he might produce a "mentor" which advises ^ach student on how 
to get maximum value from the compul-.er as a pi:oblam solving and scholarly aid. 

The most significant contribution of simple, interactive programming languages 

may be through increased student use of computers for problem solving and scholarly 

.endeavor or» individual initiative. 



rvariations" among machines, even different models of the same machine, will affect 
the language features, efficiency of operation, number of lasers, and even the 
kinds of use/ 



-Knowing^-that^J^guage^processoi: is^^available foi^a^p^ri±cular^m3cblm,_3ay_an_^ _ 

IBM S/360 Model 50, is not enough. The specific configuration (computing resources; 
assumed by the language. designers must be detailed: amount of core memory, special 
features such as meiiK>ry protection, number of disk and tape drives, terminal 
controllers, etc. 



Different implementations of a language processor, even wilh the same functional 

specifications and for the same configuration^ of the same machine, will vary in 
* 

processing capacity land cost of use. 
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Assessment of the reliability of a particular implementation of an instructional 
language and system should consider the rate at which new errors had been appearing 
as well as the number oJE presently known errors. Although programming system 
might be delivered with all known "bugs" fixed, the cantinuing appearance of three 
new ones each week thereafter would hardly be^ tolerable. ^ , - 



F. Documentation, Teaching 'Aids» and System Maintenance Available 

Complete and -interpre table manuals are -essential for various users. Such ^- 
reference materials can be incorporated in 'the processor (computer programs) to 
be printed out on request or as they appear to be needed, but in the past such an 
approach has been expensive and incomplete* Compt:c:er-based manuals continue to 
be attractive, especially for the experimental language which is continually being 
changed, making difficult the maintenance of current information in printed formats. 

\. 

An introductory manual or primer for a language and system reduces the need for 
postly-lxve instruction to initiate new users. Primers have been written to be 
used while wotking at the terminal of an interactive system, inviting the reader 
to test each new convention or concept as it is described in the text* Such 
self-instruction has also been presented by films or video tapes at somewhat greater 
expense and J.essened convenience. 

r 

Adequate documentatio;! of system programs often is lacking, making maintenance or 
improvements very costly or impossible (without reprogramming large sections of 
the processor). An institutional user should lie satisfied it has descriptive 
materials for its systems programmers ^or a itlght contract for maintenance from 

the software supplier* 

^ ■ 1 

♦ 
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n. GENERAL IMPLICATIONS OF A LANGUAGE AND ITS IMPLEMENTATION 

FOR STRATEGY OF INSTRUCTION 

o 

A. D ata Available for Automatic Decisions " 

If the system is not capable of measuring the time each student takes to yespon^, 
and making this available for decisions at the moment as well as later, then the 
lesson designer is denied this data for his instruction strategy. 

Performance and preference records accumulated one day should be available the 
next day or the next month from some strategies of- instruction. Records of iridividual 
learning characteristics may be more significant in selecting or arranging a late^ 
learning experience, than in phrasing the next question or diagnostic within the ' 

same exercise. . * \ 

\ 

Some lesson 'designers have wished to pass information from one student to another, | 
' or provide summary infoifmation for ^11, whether for normative information about | 
the learning task or for communication within a many-person game or simulation 1 
monitored by computer. y . f . 

■ . . ■ I . \ 

B. Processing Capability. Handling Character as Well as Num eric Information 1 

■ ■ " I 

' • 1 

t 

^ t 

C. Adaptability to Specific Tasks, i.e>. Convenience for DescribinR Models, S 
Drawing Diagrams or Retrieving Information _ ^ * | 



D. Generality of Procedures, e.g. ,f Separation of Procedure from C ontent, and 
Generation of Material from General Rules 



Instructional programs in which the contenjt is described separately from scoring | 
I- - , * 

an4^c^trol procedure are easier to prepare and modify than those in which alj. 4 

functions are combined in one set of statements. The content can be altered or | 

]replacela without changing the algorithms and conversely, and relative effectivepss 

"can be studied as a function of the setting of control parameters, etc. 1 

■ . -• • ■ . V 
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For some lemming exercises, the writing of such a rule to generate a large 
number of variations will prove more efficient and accurate; a larger number of 
items may be described more qt^ickly than if the author were forced to write them 
all out, and it reduces the probability of oversight or error on the part of the 
author. At ot^er times, however, when the number of -examples needed is fairly 
small or the rule is difficult to compose,^the author can save time by writing 
outreach needed variation. < ' 



E. Manipulation of Files, t>e^^ Directories, Curriculum Material, Performance 
Data, etc* - ^ 

Tlie facility for recording information in a log is of special significance in 
educational applications of computers, and was not typical of earlier systems not 
prepared specifically for computer instruction* Furthermore, the tecord of program 

status and of the occurrence of particular transactions are needed for on-line 
decisions. 

I 

The best tactic for record-keeping in a researchroriented system may be to write 
continually a log of everything which happens, and theti let the - researchers pick 
put what they need later. However, an operational system servicing students and 
teacKers economically should log only the Information certain to be needed and in 
a format suitable for quick and inexpensive summarization for use by. learners and 
managers of -the instructiofi, 

Fll^s are %ery important in a time-sharing system, and even more so in the 
instructional milieu.' Generally a hierarchy ot files should be available, the 
heavily-used files oh disk storage-^ and larger or backup files on tape or data 
cell since these modes are cheaper. Temporary files are necessary so that the 
terminal user can do ^'scratch" calculations. Some scheme of access should allow 
various read, write, read-only and write-only privileges to users, in accordance 
with the ufi«r*$ staUis* 
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III, GENERAL CONSIDERATIONS OF UNIVERSALIIT 
k. Universal Language by Establisheci Standard 

It^is urgent that serious consideration be given to means .for translating 
insfrditional materials and strategies from one institution and system to another. 
A standard or universal programming language is assumed to be the key* 

Many people complain about proliferation of programming languages for instructional 
uses of computers— -but .few people arc willing to' let anyone else do something about 
iX. Each project, each manufacturer, almost each individual user establishes 
preferences, working habits, etc., ahd would not like anything like standards imposed 
brf him by someone else. 

Attempts to impost a single major ' standard language ( or a small number of languages) 
almost certainly will fail to establish translatability among institutions. Even 
if one could assemble enough suppc rt to pMduce a definition of a standard language, 
imposing this standard would be niimrly iiifossible. Although the allocation of 
federal funds for curriculum dev^lopmenr might be made conditional on that standard, 
funds^^will continue- to come from a variety of sources, including the indivi^dual 
institutions who.generate material for their own use. 



Although strong forces will be encountered against standardization,; one common 
/language is not the important goal. Because of the great variety o£ purpose and 
process in instructional programming, a common language is. less desirable than it 
might be in business or scientific progranming. 

li there is to be only one language which all use r^ must share, then it must be 
some notation oy set o4 convent ions ^ot describing computer-based learning exercises 
or more gener^ly, uses of computers and information processing in support of 
learning and instruction. t 
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B. A Faw Cotmnon La nf. na.es as Jusn " fled bv Different Requirements . ^ 

Different purposes require different languages. In the exploratory ph^es, the 
author (or research team) should have two or ^ore procedure-oriented Languages, 
available.^ e.g.. 'FORTRAN and SNOBOL, or PL/I and LISP Y./T During latter stages 
of curriculum development, and. in actual use. with learners, 'the authors should 
have suitable procedures workbd out and compiled" (or coded in assembly language) 
for efficient operation, 'e.g.. three alternate drill strategies, two modes for 
explanation and expositions." and a number of task-oriented environments. Perhaps 
one of the languages- for exposition would look like COURSEWRITER or PLANIT. but 
it is not necessary-" and perhaps not desirable to begin therfeT^ 

Q ' 

Achie^^ement of stand^ds with ja different language -for each identifiabl'y different 
task%s probably less likely tlhan effecting a single language standard. All the 
problems of achie^.ing agreement, acceptance, and widespread use are multiplied. 
However, the essence of "universality" is "not standardization but transl at ability. 

■ •■ - "J 

C. Automatic and "Manual" Translation- A mong Languages of Similar Purpose 

- . ' ^ j . 

- ■ 1 

New languages and systems will have greater capacity for translation of instruction 

programs from present' programming languages in which they were implemented. 
■ Translatabiiity is, possible without imposing any restrictions on tjinev^ive ideas 
for language or strategy. 

Investment in a^utoiaatic translation from one language to another is an appealing 
concept; differences among learning exercises in regard to procedural aspects are 
disappearing. The major problem is the considerable cost of writing these 
translators, and maintaining them as various languages are changed. 



In some cases automajic translation is not possible because of essential differences 
in hardware. One system may lack essestial clock or interrupt features. Functionil 
differences occur in the input and output 'facilities, that is, the equipment used 



to display information to the learner and accept his responses. 
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The materials and strategy for onjs course were transferred to a new* compupr sys^t^ni 
by writing programs which automatically generated 'a set of new instructions for 
the second machine. The original- course designers had conceived of the^ package of 
lessons in a general way so tliat the number of generators that had to be programmed 
Kas relatively small. Success with this approach to trans]^ation in part depends^ 
on the extent to which the curriculum designers separate data from procedure, i.e., 
content fjrom strategy* ^ 

The current trend in translator writing system's (compilerT-com'pilers , macro-generators, 
etc*) may prbvide for dinrersity within ,a common environment. The general functions 
of inforniation processing, data structures, etc*, are provided in a basic system. 
Each groups o^ users still could extend and adapt the capabilities of the system to 
its particular task- and for its convenience. The elementary functions or processes « 
.would remain a common standard, and translation could be made through an experienced 
programanef" who reproduces the capabilities rather than. the. course. " , 

Standardization, or more reasonably, "translatab'ility" of cojnputer-based learning 
exercises from one system and project-td^anot^ler requires attentioiTto hardware 
as well as software. Import an t..,..^C^p^^ of curriculum developed for a system rich 
in interactive capability^^udio, graphic, etc.) may have to be dropped wfien moved 
to another system* limi-ted to typewriter input and output. 

Clearly som^^^^niseful work has been done with. limited terminal capability. If one , 
begina-wxtC the idea of Adaptability to various computing systems and terminal 
^devices (e&, to most general-purpose time-sharing systems available in schools of 
engineering across the country), the problem appears solvable. A specific instance 
in the engineering area is the distribution of applications'Npackages (STRESS, COGO, 
etc.). • ^ 



/ 



o 



For materials w> ich are easily described by frames of information or test 
items 'along wit .i simple brairching decisions", the author's copy may provide 
the documentation for '"Ttansiat-i-on-to another system and , language. Easy- 
entry systems can be written" for use with a, family of similar language. 
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Perhaps the computer-based learning exercises which are a) most translatable, and 
b) mosV worthyof. translation, Ere those which are viewed by prospective users as 
tools or open-ended exercise^; A topi Which an instructor can provide his students 
in- situations of his choice and with his best advice -will have a mueJh broader 
audience than a programmed ins tr. action exercise Which decides all contextual ^ 
con^derations/foir the instructor. ^ Such a tool is more readily translated 
to other compfiter^ ahd programm"^ . than the CAI materials with a ^losed 

approach; * v. * , 

Discussion of standardization andVransl^t ability is confused by failure to 
distinguish '^Lnong diffei^^'nt kinds/4f users and different levels of documentation. 
Automat/ic t^'gnslation requires complete knowledge of two systems, and is extremely 
difficult or imposs'ible if the intention to transl|ite_between two' systfems was not ^ 
considered in the design of at least one of them. Manual translation by an 
Experienced programmer requires docvunentatioi> of one type; adoption by another " 
user /requires "documentation" of another typ.e. Even With automatic translation 
of 'the basic' code, the ^^ming ex^cises may remain unused if th^ ins true tor /manage 
in charge has n^ convenient way to assess the content and methods of t}ie exercise. 

D, Communication and Documentation with a "P ubliciation" Language 

"documentation has two main, functions , information^ transmission an^ work 
simplification. It transmits information, to potential' users concerning: 
(1) contents of instruction and (2) effective \use and applic-ation of vhe- - 
• pEbgram.' It simplifies work by I (1) enabling the user to find actual or 
potential trouble spots; (2) assisting the user to eliminate. problems which 
may arise, (3) simplifying revision; arJ (4) aiding reviewers. 

At the same time one considers the means and costs of various kinds of 
translations o£ computer .programs (whether automatic^ manual, or a mixture), 
one must also consider means for informing -the ^ind^idual (pro^es8o|r, 
"^admiiiistrator, or even individual student) who must first decide whether to 
spend the resources for translation. 
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\ 

1. Among curriculum develdpfe-^a^^i^ 

• \- 

Representation of a procedure statement for a curriculum apcpert not accustomed 
to computers requires an approach diffefent from the standardized flow charting 
used by computer specialists. 

Most languages are not suitable for describing the *corit^nt and strategy of 

i 

a learning exercise, and other means for documentation are rarely used by thfe 
authors. A significant portion of a two-million dollar budget for curriculum 
development ai)d operations_inight^easJ.ly be^absorbed by the additional staff effort 
necessai;'y to program interesting strategies with, a language whlch^'is not suited 
to the task. Typically, nothing is left for documentation and distribution. 



The separation of content (definition, fact's, relations, etc) from procedure 
(rules for' review, error checking, etc) makes documentation and translation a 
much easier job, 

A communication medium for talking about instruction will promote design "of 
more reasonable learning tasks, ^and' serve also as a significant tool' for ^ 
advancing instruction research and ^strategies of curriculiom development. 

2. To reviewers and potential users ' | ^ I ' 

The difficult task of selecting a textbook or reference source for student^s 
is complicated when thfe author hides part of his material in a computer / 

'4/ 

(along with some strategy for gradually revealing it to students)* A potential 



user should not have to unscramble the' cryptic computer'^program listing, or 
extract pieces paragriph-^y-'paragraph at a teletypewriter or CRT. 

. ■ . ■ ' / , . ■ 

In most 'cases the essential information about a computer-based learning exercise 
cap' be absorbed without executing the program; /careful study of propei^^ documentation 



'shoul^ provide all the information a potential user needs about the materials 
and logic* ' ' , * i 



Project CLUE - ' - December '^1970 



I 



28 



II 4 Languages 



Retevant information is obtained more efficiently through organized exploration 
of a description of the program than through reading. individual records of 
student-machine interaction or through blind searching on-line at a student 
station for the eventualities for which the author has provided coding. 

Actual experience with a compuceir-deliv^^red exercise may be an important factor 
in, understanding and 'evaluating an instructional unit, especially if certain 
knowledge and techniques are supposed to uniold or develop during the learning 
experience. An important component of some learning experiences is affective^ 
that is, success depends on an impression or feeling of pleasure, satisfaction 
or possibly surprise, - Negative experiences might also bel^dentif led by a 
curriculum reviewer, in on-line experiei ce more readily 'than in an author's 
statement of specifications. 

3. To- programmers y 

Within a number o"* appHed research projects some means has been developed for 
# curriculum designers to communicate with compute]^ programmers: tables, problem 



:7i 



temporary measures have shaped the 



formats, special notations, etc. These 
continuing evolution of programming languages £oV instructional systems,, and 
could be formaiized into a -Citable "publication" language. 

Humans can interpret by context many statements which automatic language processors 
'find ambiguous, and this machine def iciency c^n 'be corrected only at c«Jnsiderable 
expense of .programming and processing time," if at all. On the other hand, the 
coinpute^^ogrammer implementing a lesson should receive his instructions from 
the curriculum (designer in some ^relatively constant notation which caa, be interpreted 
quickly and accurately. 



Designers of computer-based learning exercises .should be able to communicate 
directly with the computer. Whenevei; an intermediate programmer has to be 
called fn, he should respond in a way wh^ ncft only meets the immediate n^ed 
but provides automatic (computer) handling of future requests, i.e., direct 
instructions from the subject expert to the machine. " . 

December 1970 ^ . Project CLUE 



II 4 Languages ' * 29 



E. ' ilat^urarl Versus Formal. Language 

The designer of a learning exercise sbould be able to instruct the computer . 
system in a language natural tp him and to his ^discipline, unconst?rained by^s^ 
artificialities of computer notation and operation. 

The formality of. (most) computer languages is a good thing, requiring of the 
user increased attention to relevant details of his procedure. If one were able 
to speak to computers in completely uncons^trained English, an impossible situation 
at least for a very long time, his directions would almost certainly lack the 
specificity required to determine prescriptions for assistance with self 
instructlon^'utoraatically . 



Formal- , language is desirable in instructional technology for a number of reasons 
among them: tacit"^"as sumptions are excluded; ambiguity is reduced; description 
of pracedure becomes more readable; and generalized procedures; can be applied 
in other sitjoaUions. In general, a formal language appropriately requires the 
user- to reflect on what he^' instructs the machine to do. 

Education and training in a discipline, in particular, the practical application 
of wecliniques to the. presentatioji of self-instruction and other individualized " 
learning materials, stif5ers because of inadequate communication with the^ English 
laiiguage. The community of liters must us^/a relatively unambiguous language for 
discourse about purposes and procedures before it will benefit from i\ formal ^ 
language tor computer implementation. ^ y 



\ 

\ 
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IV. L'YSTEM LIMITATIONS ON LANGUAGE ^ 



A, Hardware 



-1 



Uses of auxiliary memory for updating formatted files of student records and 
making decisions in real time on the basis of certain aspects of phe'daCa ] 

, require direct access to specific portions of the information* It\is ; 
disappointing to find the disk and drum storage on conversational c\)mputing 
systems used in a tape-like fa'shion instead of as the direct-access file . ] 

devices tliey really are. / . 

* ' 1 

'When special symbols are required as in language, mathematics and the 

V V j 

sciences, a printer-type terminal device vill need special prititing ^elements 

(as in .the IBM selectric t3rpe ball) ^ or an electronic display will need 

facility for user-defined characters to be generated (as on a CRT or plasma ] 

discharge panel t^ith appropriate- hardware attachments). 

B. Software . ^ * j 

When the subject expert and educational technologist become distracted from 
their real purposes by the peculiarities of current computer systems and / 
programming languages, they should leave the computer for a time until the 
essential parameters of the learning situation are determined. If specifications , 
for human tutoring are- prepared as if for a more sopl*isticated computer system 

than is now available, techniques deve^op^d off the corap^'ter will more readily be 
adapted for computer implementation later • 

A broadly conceived instruction system probably should begin with a general-purpose 

system and add facility for moviUig from the tutorial mode in^ other 

user sub-syst^ems and returning when an exercise is complete* The author of 

a problem ^set may need to maintain contact with ihe student through some 

means of monitoring his work on a probleni^ and then bring him Jsack to the 

tutorial mode becaUs€^o*£ elapsed time, number of^jroblem attempts, or even an 

anticipated error vjiich requires special attention, \^ 
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Instructional systems should incorporate many programming capabilities which - 
c^ be used by both author and student* In additioti^to simple computational 
aias, some lesson" designers wiirwant to provide an algebraic language, a 
't^t-processing language a model-building or simulation -language, perhaps a 
specific system or model written for student use, or information organization and 
retrieval capability. - " • i - . 

C* Communications ' ; - 

Each terminal device for communicatidn between the "^computer and the user has 
physical and\pgical characteristics which determine the kinds of instructional 
techniques and/or -computer s,ystem co^ifigurations for which i^ may be suitable. ^ 
The suitabilji^ty facrora include facility for messages from users to computer 
(input); messages from computer to user (output); distance between computer and 
user; cost of communication link;. cost and reliability of device. 



The rate of message transmission from student' to computer varies widel?f for^ 
different ap'plications, but it averages out to about one keypress every two 
seconds, in<:luding' the time for. reading and thinking. The machine sends messages 
to each user in blocks, but the rate averaged out over all the time the student^ 
is reading or thinking Is about two characters per second. 

V • . • ' ■ 

Co^unication costs usually are significant in servicing remote terminals in 
large numbers and/or at long distances. Since sonte devices require a voice- 
grade , telephone channel but leave it 99% unused, some arrangement for multir 
plexing will allow many . terminals to be serviced' by a single line between ' 
the computer and the site of the cluster of • terminals. ' 



If a diagram or picture must be read from a video file aji*<rciated with the 
central computer, much communication capacity will be required to get it out 
to the local terminal quickly* Al tentatively. It can be sent slowly before 
it Is needed, and then -displayed as often 8,3 necessary from local storage . 
associated with the terminal, , - ^ 



/ 
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Summary of Cost Considerations 



Other media than compajters will continue to be less expensive for storage, 
presentation and testing; the economics of computer use are more favorable for 
practice and recitation exercises, where a greater degree of exchange between 
learner LAd data base is typical. . 



The response time an^cj operating, costs for any particular user depend in large 
measure on the priorities established for tha^ kind 6f user when the system 
was designed and tuned. • \ 



\ 



Techniques for preparing curriculum files must be more powerful in the senseX 
ot fewer hours required of the subject expert to write and revise materials 
which achieve the ^objectives intended of the. learning experience. Authors f ^ 
cannot often afford the luxury of individually shaping or tailoring eachViine* 
of text^in each frame for eadh kind of student. ' ^ ' 

It is today^.^cheaper, and in some instances perhaps more convenient, to handle 
some desirable translatoi; features manually with clerks and writing assistants. 
The nexf idjportant step? is careful development tod evaluation of language . " 
features^hlch adapt ^o the needs -of authors and subject areas* 

Conversational Tanguages emphasize convenience, and sometimes Require considerable 
additional cost in computer time during execution* The number of operation^ 
for interpretation of a symbolic program is always greater than for execution 
of a program alrea.dy compiled .into machine-level statements. Of course a pser 
may be willing to pay more for execution if^'hi% resi^Cts will be available ' 
immediately and without complication, along with q^ilck diagnostics and 
opportunities for changes in ^tie program at stopping rioints tproughout'. - 



\ 



December 1970 , ' , ihfpject CLUE 



\ ' . ■ • 33 

II 4 Langua^es^ • . ,^ • . ' 

_ - ' - * 

■ V. DESIGN CONSIDERAtlONS . 

Rfei^fttra4.ventures In time-sharing warn of the inherent difficulties in such ' 
endeavors; In-tt^al hardware investment^ is heavy; staff members must be,yery 
competent and well paid; results lag far behind ef'fort invested in the project. 
A point* too o£ten Overlooked by planners of new instructional projects is that 
time-sharing systems need' large .development resources, much larger^ than most 
researchers can afford.^ ' . * 

t 

A. Adaptability « . - • 

■ . ' ' ' ■ 

Facility for definition of functions should be extended to provide for definition 

' - • * 

of a) character operations as well as numeric ones, and b) , distributed 
operators which app^ly. throughout one or more statement lines. The latter. would 
allow foridefinition 5f new operations with convenient formats for specifying^ 
answet prlcessing. 'More thk one line should be permitted ±n the definitions, 
and the possibility of an operator .being distributed among two or pore variable 
names must b4 allowed in the parser. ^, 

oiie way to extend language to handle^itional^ applications ts/Co provide 
linkage to other programs .^ No one langlS^ now available can handle the total 
variety of applications efficiently, and s|me useful subroutines may already 
be available in other languages on the same" system. The major problems seem 
to be:, 1) transferring data. 2) re tiif^iing- control to the calling program, and • 
3) leakng'^the user in control in spite of program or sfystem errors. 

■ The problems with extending a language through definition of "new operators 
aJid staLment. types concern the internal -representation of the language, simple 
rules f ok, describing new features, and the ability to recognize operators 
distributed throughout a lisj^f variables even on more than one line or program 
statement^ ' ■ 
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l^^s not obvious what the elements of programming should be.. The basic statements 
aid operations need to l>e elementary enough to permit building the variety of 
processes -desired by programmers. However, high level command, should be 
-assigned to frequently used routines constructed by programmers in a way that 
the syntax can be reaolly.used i>y curriculum designers. . 



5. Economics 



Variety and flexibility in prpgramiJng capability of an instruction system are 
.not necessarily incompatible wi s:h ^economical Operations, Early decisions by 
system designers about specificidly what is needed by users inappropriately 
limit the scope of applicatttish;. 



1 ■ 



^ New features defined within an interpretive language for execution as needed 
must be reinterpreted eacn time the function is- us4d, and little economy of 
execution results. The abUcilty to, compile or assemblev^^^utine , link it to 
the interpreter, and specify Its execution ^n a statemen^t form natural to the 
usep will incr^se convenience while m^aking. certain Informatiop processing 
operation^ more economical to perform. ' * ^ 

One way* to accomplish some economic advantage is to jeassemble the interpreter, 
* adding the new statements, functions or operators to* tlie language. This 
delays availability unless an informed system programmer is always at hand. 
Reassembly fbr one user also raises some questions of proliferation: ^Should 
he then have his own special veision; do changes in the basic compiler take effect 
for everyone? 



A recent addition to the tool kit of a system arcla.tect±s microprograpning. y 
The machine's instruction repertoire need not be wired-in; rather the processor 
is itself an interpreter of microprogrtnns which are loaded in special memory, 
one for each instruction. For interactive and conversational uses the savings 
. can be substantial in both time and speed.. • . ^ * r\ 
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Jobs without response-time constraints- can run ^^^^^^ ^.^f 2"""*^/.° . _ 
us; any excess (idle) processor ti^ne. However, such- 3obs could destroy any 
benefit by slowing interactive responses and forcing greater- overhead. 
Fixed memory c.n be allocated to the resident background jobs, but fine tuning 

is che trixiky pari . . • • 

C. Mocfitlar'ty . 



Language processors are usually desired in modules. Logical- separatio^ 
facilitates locating an error in the processor, introducing changes, an^ 
reprogramming the processor for use within\ another operating system. \ 

It is not the modular concept but sensible programming whllch makes a dif fere^ice. 
. Separation into bl9cks of statements which h^ye Uttle if I any interaction is 
' only a -.^ay to encourage sensible programming^* ,1 



D.^ Documentation 



Encouraging uses of a system and language- which has inadequate documentation is 
lik^y to lead to diskppointment for users and frustration for those responsible 
for mainta.rning service. Errors or other considerations requiring modification 
are certaih to arise, and the processors should be adequately described for^ 
meiintenance purposes , - ' ' ' ■ 



:£rdject CLU2 



December 1970 



3^ r "\ . II 4 Langtiages 

VI. INTERACTIVE MODE CONTRIBUTIONS TO LEARNER AND AUTHOR 

A, Immediate and Responsive Reply 

The essential contribution of interactive programming must\ involve responsiveness 
of the system, and this factor provides special benefits f^r the casua^ 
and infrequent user. He may be veil advised, when unsure^f the p rope r\ syntax, 
to try various likely ways until the interpreter accept^ one and does wh^t^J^e 
intended: ^ Better yet, the processor should tell hlrr)/^hat form to use the first 
time an uninterpretable statement is entered, or ref^^him to the section of a 
reference manual which is likely to explain away his confusion* 

. • • ■ ■ \ ■ . 

If diagnostics, provided at the moment and backed up by references to readily 
available! liter^ure, can relieve the user of concern for the means to. describe 
his .procedtire, he will give more attention to solving the prc^blem, A shorter 
elapsed time between problem, definition and solution, and the \ime savings 
attributable to continuous working sessions provide another bonu^. 



Much of the enthusiasm fpr conversational computing languages may relate to I 
non-essential features; quick response and understandable diagnosticsXcan be 
provided' in batch systems* *. * ' ^ 

B. Ease o f Conducting a Dialo^^ue and Lea rning the Rules ■ 

■ ' ~- ■ , V . I 

* ' - ' ! I, 

Interactive progr^^ing languages incorporate aids for program testing in a very 
natural way. The same sj:atements with which stored programs are written can be, 
used as direct commands to the computer to print the values of selected variables, 
assign new values, to test 'other parts of the procedure, and resume execution 
with any Tine" of^re^nt-<>£^the „E??iram.. 

A ratheir deep search for the-.lopns of a syntax error and some attempt to interpret 
the intention o£ the user in spite of ambijuity should help ajong the dialogue 
between user- and machine. This requires a cleverly written processor with 
auxiliary memory and decision rules which generate special user assistance. 
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Naturalness ib an important factor inlusdng -a language, and' is achieved by 

internal consistency as much as by relation t© inative language. General -inventions 

should apply throughout; the user should be able to predict a rule t^asn't 

been told yet, and one aspect, of the hbtation should -riot, interfere with 

his' recollection of another. • » 

The dialogue between user and program should be\truly a' dialogue. That is, 
there may be time when the comp\ater should t^e the initiative, setting up 
Vtylized instructions and asking leading questions, andothef times when the 
user takes over. However, "throughout this exchange, each may interrupt the 
other to suggest a new arrangement. 



C. Flexllllitv During. the WorklnR Session 

Interactive mode of work should provide Oj^portunlty for sketchftg out an Idea, 

testing parts of it,, going back to fill in detail and make corrections, etc. 

The user should elect an on-line environment because it helps him conceptualize 

a procedure and solve a problem, not simply because it is an available way 
* 

to enter a program into a computer. 



Somehow a processSjj might recognize when a user is making temporary notes and 
when he wi she s^;^^ Work to be save cT for future use. At least the user should 
be given a conv^ient notation for de'signafeing the expected , permanence of cfirrent 
instfuctions'', and a%eans to,fetrieve later so^*thing^umi_to be ot greater 
value than originally perceived* 
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* These statements have been selected from published and unpublished literature 
to represent various points of view concerning evaluation of- computer-based 
taaterlals and stirategy. Most have been shortened and some altered to convey 
the Intent in a few lines within the context of a larger outline, and to 
point out similarities and differegices with related posit long. 
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unfortunately, current learning theories do not enable us to match the function- 
ing of the human mind against the functioning o£ the computer . ' No mif ied theory 
exists: ' one--that of "complex stimulus-response chains"-seems to explain some 
processes. another-"cognitive structuring of ^ field"-other learning processes. 

(NCET] 



Optimization is pointless and even of negative effect if the measui;es implied 
by t:he model are not relevant to the educational goals. ^ Successful application 
of optimization assvmee that a psychologist can represent -accurately the 
state of knowledge of a student at a given time and that instruction will in- . 
fluence the transition from a faulty state of knowledge to a more (fesirable one'. 

• Some models of learning are too simple to behs. pful. The CDrresponding 
procediires for optimization in suqh models do not take into account important 
factors of motivation, context, previous learning, or learning style. Other 
prescriptions ^fior learning, some of which are called models, cb notnake suf- 



ficiently spec 



:i>f ie-'ifceference to the initial or 'interim "obtjervable tehu 'Dr of 
the learner ai^d, therefore, are not useful for managing instructioi<. 

• • [GLUE Staff] 



\ 
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CONTRIBUTIONS OF THE COMPUTER 




A. Contributions ot the -Computer to Learning 



GAI reduqes time, for completion of a lea'mlng task ^ ■ ■ ■ 

CI contribute, to improved .attention during le.min, in ..o ^^J^ ^...i^ 
interaction betveen the student and the CAI terminal focuses and , 
l: TLdiate leamin. tas.. Second. CM syate^^ have ti.in. procedurea that , 
allow one to aet maximuB limita for reaponae time. , . 



A diacuaafon ^boitJrndlviduaUzing.lnstruction'.ia l^'''^'' /^^^^^^ 
"the ■weather. For preaent purpoae* ve don't need a preciae definition of "Wther 
a l l, reaort to our intuitiona. and recogni^J when theae-intuitiona .re vi a 
r, an LLle or a atatement'. «e alao recognise the difficultiea of predictins 
weather; the aa»e i» true of individujy«ing inatruction. , 
Achilvin. individualization in inatruction ia an heroic.aa. » - ^ ■ 
impoaaible in .any aituationa Teachera can carry the burdena of ^-^^^^^ 
■in traction only to a li.iteci,e«tent. However, the widea^reaj u» ' --^"^J^ 
- ,or individualization of inatruction aee»a practical and 4 feaa ble alternative. 

[puppes] 

i 

If the ittt«nt U to iMtruct .tui-at. .o that .11 irlll achi^w. final l.wl of 
co«p«f ncy which meets (or surpAsses) « idnWly uccmpUbU performance criterion, 
with variation only In style, speed, or level of achievei^ent. idiosyncrasy cannot 
be cultivated. Education then becomes what an i.idustriaifengltieer might call - 
mass nr<f3uction to narrow specifications with rigid quallJty control. Each pupil 
!• frC to go more or rapidly •xactly where he is told to go. 

tO«ttinger 'tod Marks] 
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Maximum freedom is not necessarily a condition for individualization of instruction* 
Rather, some concepts of individualized instruction might include ends that the 
student himself defines as well as thoseT ends which are staged behaviorally by 
«o»ftbrdy other than the student. : ^ [Becker] 



Contributions of the Computer 
To the Solution of Educational Problems 



1, Present and potential contribiitiions 



Computer-assisted instruction (CAI) is not the panacea ior today's educational 
problems,, and it would be a mistake today to introduce CAT on a massive scale* 
On the other hand, it also would be a grave mistake to reject CAI as* a short- 
lived phenomenon of curiosity that shoul(J not be taken seriously until it has 
been proved. * " ' [Stolurow] _ 



Many of the assessment, diagnostic, and remediation practices of school psycho- 
logists may be dramatically facilitated and expanded by computer-controlled 
interactive devices. If a significant proportion of the clinically-oriented 
school psychological procedures could be automated, then the current logistic 
limitations in--terms of available professional personnel and the desired range 
of psychological practices ^iJould be resolved. 

Computer- ass is ted instruction has two major implications for the field of 
school psychology. First, a direct impact on the range and types of psychological 
services in a school system could result in achool psychology becoming antici- 
patory rather than reactive in style and practice. Second, "crTc school psycho- 
logist will find CAI provides opportunities to pursue psychologt^.cal research 
.in a natural, pedagogical situation.^ [Hansen] ^ 
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Th€ evidence clearly 'indicates that CAI teaches at least as well as live teachers 
or other media, that there it- a saving in time to learn, that ^students respond 
favorably to CAI, that the computer can be used to accomplish heretofore impossible 
versatility in branching and individualizing instruction, that true natural 
instructional dialogue is possible, arid that the computer will virtually perform 
miracles in processing performance data. , « [Feldhiisen a ] 

There are some things which CAI is able to do better than any other media: 

1. Secure, store and process information about \^he studejit's performance 
prior to and/or during instruction to determine subsequent activities in the 
learning situation. 

2. Store large amounts of information and make them, available to th^ leamar 
more rapidly than any other medium. - . - 

3. Provide prograraned control of several media such as films, slides, TV., 
and demonstration equipment. . ^ * ^ 

4. Give the author or teacher an extremely convenient technique for designing 
and developing a course of instruction. 

' sl^^^Jro^rfrde- a dynamic interaction between *student and instructional program 

not possible with most other media. ^ .i* . ^ , * ^ _ ^ 

(Feldhusen b]" / * 

/ " 

The student^ the teacher, and the author can be economically provided with informacion 
in a form suitable to the needs of each. A CAI system eliminates the need for a 
large amount of separate data processing to miake educational lise'of the data. 

tolUrow] 




The potential of CAI to provide aUaJor breakthrough in educational, practice arisc^s 
from the capsbllities^of a wall^engitieered CAI system (includinp instructional 
software) to provide an ^intensive level of individualization not possible before on 
a mass basis. The potential also arises from certain Interactive and display 
capabilities of computers which possess unique promise for new forms of contact 
betiTMn iaaroer md subjact matter, [Mmdmncm] ^ 
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To a limited extent a computer can substitute for a teacher in the learning process. 
When it does so it has the advantage of being "in direct one-to-one contact, and 
though less flexible in response than a teacher, it is at least^onsistent ^ 

Regarded as an educational resource, .the computer itself can become an agent 
for innovation. Its capacity to present complex simulations and to perform 
complicated mathematical calculations at high speed offer new^q)portunities in ^ 
many ateas of the curriculum in schools \d colleges. [NCET] 



Possibly the greatest potential of computer-assisted ii^trufrTion is Its capability 
to pro^ade the^sttdent wfth a facility for manipulating, redesigning, and re- 
arranglfng-tW jelements of ,a„subject matter. * [Glaser] 

If Statistical results obtained in the McComb "program '(CAI favors Negro and 
low-income^groups ifeg&rdless bf /teacher ability) can be replicated in other southern 
schobl districts, CAI "drill-and-practice programs can make a significant difference 
in improving^^ducation in the South. [Prince] 



There is no reason to believe that this new technology will necessarily de- 
humanize man. There are many/ things in this world that ckn be d^ne better by 
machines than by human beinga* The advent of the computer clearly points th^ 
way to major changes in education that will free the individual, both teacher 
and ttudasit, to lnt«r«ct tn aore hwan ways than ever bafort* [Holtman] 
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Those opponents of ^technology who claim that it is dehumanizing to education 
are admitting their ignorance of what is actually occurring now. There is ^ 
nothing more dehumanizing tl^an to have a youngster who does not understand 
be subjected to having the rest of the class rove along ^ithout him; or to\ 
have a young^er who wants to know, but who is not outgoing and is rfraid to 
ask, be subjJbted to the , torment of knowi'ng that he is not aware. It is no 
more dehumanizing for a/educator to use technology than'itislbr a surgeon to 
use the most modem ofA^truBents for making incisions. " [P*g«n] 



2. Comparison of the Crap^ter with Other Media ;^ ^'^^fr^^/'Kj ' 



The uniqueness of a GAI system resides in the computer which provides two 
significant capabilities: a large memory and flexible^^ioglc.,^^^ While memory in 
a directly dlsplayable form also is provided by a va\iety of oth^'r teaching 
aids, ojily the computer provides the 'detailed colllt^ random-ac'cess memory of 
each student's responses to individual displays of Instructional materials in" 
a form that is directly useful for automatic profcesslng. No otker aid provides 
the computer's logical capabiliti' for organizirfg information ^tb make it dependent 
upon the characteristics of the individual student. • ' jj^^tolntoy] 



-7 



Computer-assisted instruction is distinct fiom other >edia in Chat it is a potential 
means for making instruct^n a truly indivldualikedj^roc ess through the use of 
a variety of media utilized to support a jiystem of Instruction. While programmed 
instruction and language laboratories appear to ^individualize instruction,, they ^ 
actually only take the first baby step in that direction by allowing the student 
to proceed at his own rate. Mass mfe<lia approaches have provided illusion of 
economy; hidden are costs of revision" required to reach diffetent segments of the 
total audience. With CAI we could individualize materials electronically rather 
than by htod. . ■ ' / • . / [Stolurow] 
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^One of the advantages the CAI system over other modes of instruction is the 
dynamic interchange it p_^vides between student and instructional ^stem. The 
system gives the student a set of conditions that are responsive to ^^^^ 
performance • While this is also possible^wit^ programmed instruction 'teing 
printed books, programmed /instruction does not achieve flie level of so^histiclition 



or provide the alternatives that are possible with a CAI system. 



Lurow] 



Setting up a computer to teach children is just idiotic — a simple programmed 
workbook wUll do what the computer xan do at one-tenth the cost. [Skinnier] 



Even" when computet technology makes possible the acceptance of cral responses, 
the most effective supplement to the teacher's role in the learning of reading 
will probably still be the less costly devices such as the *Language Master' 



and the ^Talking Page.' 



[NCET] 



The practice of numerical skills is often related to a need to solve particular 
probleii\s, and the most useful aid would be a checking device which could be a 
computer; but could be conveniently provided by a simple machine, , [NCET] 

Institutional needs which do not seem to require intensive individualization 'oi>* 
unique computer* capabilities (as exploited in simulation, gaming^ cr problem 
solving types of lessons mingled with a relatively ^small amount of tutorial 
CAI) can often be served adequately by some in^ tructional medium other than 
„CAI. [Bunderson] 



r 
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ideally, a teach'ing conversation with a computer can be extremely individualized, 
drawing heavily on the pfevious^'training, abilities, and performance of each 
student. A kind of complexity and itidividualization ispssible that could be 
far greater than is obtainable either Brom programmed books or simply non- 
computer-based teaching machines. " \ . [Bork] . ^ . 



3. Limitations and other considerations 

- r ^ ■ . • ; - 

The growing pains of CAT are evidenced by: 

1. Pretentious theoretical (Specuiat^ns, 

2. ^ Grandiose expectations of a majgr instructional role in schools. 

3. Poor quality instructipnar programs and little c^r no evaluation. 



4. Infatuation with computer hardware and systems. 



[Feldhusen a] 



The cost per student hour of instruction is hopelessly non-^competitive with, 
most -in-^chopl^ instruction, excep^^p rob ably some vocational and special or remedial 
education. However, technological developments will substantially reduce the cost 
of CAI, while personnel costs are rising. Also' computer systems will be used by 
schools to perform functions other than instruction, and tHe biilk of system costs 
will be bome'by these other function? (such as ^administrative data processing). 

- (Morgan) 

v. ■ ^- . ' ' 

It is important not to consider CAI as a learning process which Involves the 
computer solely: ttfe "system" could include, for example, teachers, printed 
material, and linear programmed texts. Many" experimental developments of CAI 
have been ineffective^'be cause they have attempted to put the, whole process on 
the computer rather than selecting, those parts foif which it is most applicable, 

# ' ' {NCETJ 
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If there has been^o clear-cut objective at which to aim, it is very difficult, 



if not impossible, to assess the success — or othervis^-'-of a project. When 
to^d that CAI is "better" than classroom teaching, one must -ask flie question, 
"h/)w do- you know?" Unfortunately, this question nearly always goes unanswered. 



/ 



[McLaren] 



/The primary mechanism for moying the computer into the classroom is discovering - 
discipline relevance; learning how to program an'd paying for computing services 
are only secondary. Suitable demonstration of curricular packages will enable 
the teacher to appreciate the relevance of particular algorithias to his subject 
area^and gain facility with their use,. Although in most high schools and in 
many coiife^es and universities resources have been sufficient for only token computer 
use, more realistic support will become available to incorporate these token ventures^^ 
into the general education prograx. " [LykdsJ 
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out similarities and differences with related positions. 
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I. UNK^UE CONTRIBUTIONS OF THE COMPUTER 
A. To Research on Leamlii^ and Teaching 

1. Specific benefits - - '^^ . 

I 

Research done on verbal learning (e.^., Fraze's work on tfie arrangement of parts 
of speech in a sentence, and Rothkopf's worU on the placement of questions with 
in text) leads us to believe that the computer can help considerably in facili- 
tating replication, modification, and, in general, more rapid progress in 
experimentation. ' , [CLUE Staff] 



jCAI should be used as a vehicle for new basic research on learning becaiise of 
its unique capacity for controlled stimulus presentation, ^interaction with the 
learner ,^ processing of responses,* and storage and processing of performance 
d£|ta. CAI should be especially useful in research on verbal learning, . 

(Feldhuscn b] 

One specific advantage to be gained from a CAI system is the capability of , 
doing research on teaching undet , Qontrolled conditions and, in particular , 
under conditions which individualize v' ;nstruction. Another advantage is 
the capability of doing research on var.^ .u^ modes of teaching with die ability 
to collect detailed records of student ^ \^ ^ ^rmance that permit evaluation of 
the effectiveness of the teaching proce. ^s, as well as of the effectiveness 
, of the material. [Stolurow} 
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I 

Research ^conducted with a CAI systein can offer the foJ.lowlng benefits to an 
educational psychologist: - * 

1. Reliable presentation of stimulus materials. 

2. Convenient manipulation of one parameter while controlling others. 

3. Rapid interpretation of data just collected. 

4. Consistent replications. 

5. IncidentalVadministrative and computation uses. 

, \ ' 

6. Readily accumulated data from remot-i locations- 



?• - Research paradigms including complicated contingencies, - , 
8, "Pin ball machine effect^* to :.eep e.^n-arimentar suj>jects interested- 

^ [Gilman] \ 



2. ' Some warnings 



Although CAI systems can handle a variety of psychological experiments, few 
studies will require th:^o i.^t/e or sophisticated equipment/ Infatuation with 
or availability of hardwaife may be the cause of unnecessary automation with re- 
sulting problems and expense. 

~ One study was the only co'^ole ted product of a six-month project^wlth a 
half million dollar yearly research budget. The study has sinde been replicated 
with a small 'solid state teaching machine (called a Didactor) that cafi be pro- 
grammed to do many of the reseatch paradigms of a large CAI system. The total 
budget for the replication was less t^han five hundred dollars* 

^ ' [Gilman] 



Although CAI> with its versatility, can be^an asset to the educational psycho- 
logist conducting research on learning, the' present state-of-the-art will cause 

* ' ' 

some problems. Th'e resea/che?r shouid consider CAI a technique to assist him 
in learning about/behavlor, rather th^ a facJLllty he must somehow put to use* 

'\ . \ [Gilman] 

! ' . . > 
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B. U nique Contributions of the Computer 

To the Development of a Theory of Instruction 



The field of instructional use of computers is still in its infancy, and .the 
facilities and materials are not yet adequate for development of anything so 
general as instruction theory. So far most of the work has been concerned 
with developing the technology. [CLUE stafif] 



Probably /"the ma^or problem with CAI today is that its current level js mistaken 
for its potential level. In effect, CAI makes our meager knowledge of teach- 
ing p£t*tently obvious. , . 

Our most pressing problera is the lack of an empirically validated theory 
of teaching, and in fact we even lack a*useful set "of empirically validated 
principles of instruction that could fcorm the basis for a theory of teaching... 
Hence, one of the most vital functions of CAI is, potenwially, the develo^ent 
of an empirically-based theory of teaching designed to mnet the requirements 
of individual learners. - ' [Stolurow] 

CAI developers ought to leave to others the develjgpment of theories of instruc- 
tion. Instead, they should study and glean what they can from established theories 
of instruction * ^ * <^ y 

\ *^ [Feldhusen b] 



Probably,, the most significant contribution of CAI has been an jndirect one. 
As researchers tried to progr:am m.aterial for the computer, it soon became 
apparent that psychqlogical theories of learning were not entirely adequate, 
and what was required was a theory of instruction. [Molnar] 
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CAI has growji* ra 
search and applieH 
of poor quali'ty a 
theories is proc 



•pjidly 



into a dynamic and proraising~f ield for educational re- 
instruction. While the empirical research per se is often 
id poorly reported, the development of systems ai'ci ins tructional 
ing with great promise. [Feldhusen a] * 



e 2d 



\ 



CAI researchers sc 
instructional 
pose of alerting t 
gration. But 
alternative views 



ould feel free to work within or without the constraints of 
thedry. For "some, theory development serves the heuristic pur- 



he researcher to all relevant aspects and of providing inte- 



adhejrence to a single theory also blinds the researcher to 

Thus, some people will thrive by being eclectic and exploratory. 
» [Feldhusen b] 



Even if it welr^ possible, a theory of CAI would be harmful in that it would, . 
blind the CAI d^v^loper-researcher to the broader . range of instructional resources 
whifh should be tapped in ileveloping a program of instruction* In a sense, this 
is the } sin which Pl-f esearchers and developers have been committing* They have been 
blind to alternative forms or media for instruction* [Feldhusen b] 



Another possible advantage of the learner-controlled statistics course is the 
disco^ery of routes through a given subject matter ^rom the studenj'a point of 
view* Another intriguing avenue which opens in <:he leamer-'controlled statistics 
course is the provision for learning either by an inductive or deductive mode of 
reasoning, [Grubb] 
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II. GUIDELINES FOR FUTURE RESEARCH 



/ 



/ 



A. Role of Individual ,Le<:mer Differences 



/ 



Instructional systems need to be developed/ to 'respond to individual differences 
in an efficient manner. Guidelines for dbing this are "np't yet established. This 
goal is not being served by other more/established propedures; consequently, this 
should be the main purpose of CAl* / [Stolurow] 
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There 'is little evidence from res/arch to support the view that individualization 
of instruction is the sine qua non of learning* Widespread practice in schools at 
all levels indicates* that much, but not all, instruction can be carried forward 
in groups* ' [Feldhusen b] 

Research en the interactioa of individual differences with various methods of 
instruction has produced few significant results* This may be due to poor selection 
or measurement, weak methods, and/or failure to secure appropriate assessments of 
ongoing performance* Continued research efforts should be made to explore the claim 
to individualization of in«truction* [Feldhutcn bj 



The conceru about individuiilization has been mostly lip service. It has not been 
detined operationally; present attempts at Implementing it are rot complete 
enough and have'been squeezed back by institutional pt^^ssures; and it is also 
extremely difficult to accomplish* Many current experimental computer* instruction 
prpgrams give onjly be illusion of individual tailoring* [Oettinger and Marks) 
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The most pressing need in education is the individualization of instruction. 

Education dedicated to this end not only maximizes individual competence but 

provides every individual with a .sense of pride and uniqueness aid a feeling 

that "he can contribute as a fullfledged member of society. I^he^^ftie individualization 

of education is taken seriously, it is difficult to think in terms of such 

categories as "the very talented," "the disadvantaged," "the handicapped,"- and 

so forth. Rather one thinks in terms of the capabilities of each ifidividual 

and how to provide an optimal educational environment for that individual. [Glaser] 

Individualized instruction requires instructional decisions 'relevant to each 
student. The differential decision-making function in individualized- instruction 
is a central issue, and these decisions require a great. deal of information about 
the individual student. ' . ' . " t^ooley and Glaser] 

pons'iderations for recognizing individual differences include: rate of student „ 
progress, selection of instructional objectives, and student control of program 
branching. Only the computer provided a reasonable means to keep track of everyone, 
match resources with individuals, ^d schedule people and materials at the right 
time and place in an entire educatio\ial^nstitution. [Holtzman] V 

'Tlie discovery of the types of interactions^>et;7€er^ differences and 

learning variables is perhaps one of^he toughest problems the psychologist will 
have to face. The kinds of indi^^ual differences referred to here are djTfferences 
which develop from the long^;;^™ history of the learner: .aptitudes, learning 
styles, personality charardteristics influencing learning, and prior training and 
knowledge. ^ . ' . [Glaser] f 

B, General Guiaellnes for R&D ) 

Research on learning with CAI numt continually addre«« itself to the criteria of 

success. One bad way of avoiding th-e criteria problein is to use available test 
instruments which inadequately approximat-e the goals of the program. The CAI 
programmer must specify the intended learning outcomes and develop suitable 
criteria behavior measures* , . [Feldhusen b] 

Project CLUE , December 1970 
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Applied research shj)uld focus on knowft principles of learning and on capabilities 
specifically rel^teli to computers • For example, research on learning suggests 
that specific Inf orinatienal feedback to the learner about th^ adequacy of l\is 
knowledge or perfoirmance increases the amount learned and liked by the student.. 
Thus, a wide variety of tests of this proposition should be devised in the CAI 

7 , 

setting' to verify/ its application there. Researchers earlier found that^he report 
of correct answers in a programmed instruction format had little facilitating 
effect on learning, perhaps because initial performance was so highly prompted 
that there was /little possibility ^of 6rror in performaace or need for correction. 

\ ^ [Feldhusen b] ' 

Research aJd evaluation functions related to'^CAI must be clearly defined at two 
levels: l)/during the development of CAI materials (guidelines by Scriven, Markle. 
DAVI and fZpham are relevant) and 2) after the CAI material has been developed and 
is ready ior field" testing and use in CAI research (Campbell-Stanley guidelines are 
relevant/. Much of the research has used the limited experimental-control group 
design /i-th small numbers of subjects, poor criterion tests, and brief treatments.. 
I [Feldhusen b] 



A na/ional program in the UK should apply some of the known concepts of learning 
theZry and techniques of ^mputer programming to the task of preparing a variety 
of/cAI teaching programs in different subjects. 

However, because a ".learning system's model" (or even a teaching one!) has ^ 
/ot 'been identified, it jis unwise to base any national program solely on the results 
/of basic,,research into learning theory or^b-Bli^vipral patterns. Rather, research 
into learning 'theory should proceed simultaneously with (but not necessarily as 
part of) the developmei^t of. national programs. [McLaren] 
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<^ ' - * 

f ^ ■ , / • ' _ . 

CAI is now and will for some time remain in & research and development (R6D) 
status. /The 'major areas of need include the development of inexpensive yet 
enriched student terminal devices, author and stuJfent languages which better , 
exploit the computer's unique capabilities, and tW^evelopment of instructional 
design proc^edures and facilities which will yield effective and well justified 
instructional programs. ' A more general yet more basic problem is that of 
developing educational environments which are compatible with individualization. 

V [Bunderson] 



CAI may never rsach its potential unless continuous progress programs are developed 
on a wide'scale. These may 'involve media of all sorts in addition to computers, 
and may he conducted under new management models for instruction which emphasize 



ind i v i dtfa^rz a t i on • 



[Bunderson] 



( ) Perhaps ten years ago the promise ^Df^ computer control and analysis gave us an 

illusion of having greater control over experimental design. It -simply has not 
worked out that the experimentation takes care of itself • Some research studies 
are being done on the computer systems simply because the systems are available 
. and must be justified. The laonster with its^monthly rental requires new research 
money all the time to maintain it. Administrators should look to alternate 
facilities both for conducting the research wherever possible and^ for administering 
the instructional materials^ [CLUE Staff] 
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Computer systems as they are designed today dp/not provide a rich enough - 
enviroriment for some contributors to development - ^ 

of %utoirfated learning exercises* Therefore, some work should leave the compu^r 
for a time, perhaps the next five years, in ordef to explore strategies not 
necessarily dependent on computer processing of natural language. For example, 
one might set up learning environments and problem solving situations in \^iiich 
he studied the behavior'-of a student while solving problems and acquiring' concepts • 
Although the computer mi|ijt be used as a tool in modeling the student's behavior, 
communication between the environment (eventually to be automated)^ and the student 
would be carried on by humans. Critics of present usfes of computers for instruction 
want more effort expended on a more fundamental purpose; namely, the better 
understanding of student learning and self instruction in semi-automated environments 

[Zinn a ] 

^ # * 

Expensive, on-line systems will continue ^to be used for research on learning and 
teaching and for development of self --instructional programs. Computers and 
communications are especi.ally important because the training devices can be located 
in public school classrooms, business offices, and engineering shops or laboratories, 
through which 'an infom^tion processing system can instruct, answer questions, 
deliver tests of understanding, record data, and test hypotheses regariiing 
instruction and learr.^ng with great detail and over long periods of time* The 
capability to introduce experimental control into situations satisfying the real 
demands of education and training will reduce the present discrepancies between 
contrived laboratory situations and actual applications of learning principles in 
training and education. / [Zinn b] 
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Before subs^tantial amounts of new CAI research are undertaken, some major 
systems problems should be solved. First, an inexpensive CRT should be perfected 
to replace the typed message. Second, the student interfat:e should be developed 
as an efficient and pleasant carrel which affords access to several media. Third, 
time sharing service and terminals should be abundantly available to avoid 
artificial constraints on instruction. Fourth, one set of programming languages 
should be developed for several modes of instruction such as didactic, inquiry, 
'and computation-, an^ for the author mode, ^i^th, some lengthy -courses (3-6 credits) 
should be developed to serve as vehicles of research . and as models c£ CAI potential. 

With suitable equipment, systems,' dn^d instructional software, CAI research 
can then come on hard and hopefully begin to. produce significant results . 

"* [Feldhusen b]. 



Project CLUE 



?)ecember 1970 



\ T- - 

14 \ ; II 6 Research 



III. SOURCES \ ^ 

1 

Becke-, James W. ^'Educational Technology: New ^^yths and Old Realities" 
(discussion) , Harvard Educational Revtev , 38: 74^750, Fall 1968. 

Bundersobi, C*. Victor. "The 1967-68 Progress Report, \ Austin: Computer-Assisted 
Instruct!^ ^Laboratory, University of Texas, 1968. 

Cooley, WilLiarc W. and Glaser, Robert. "The Computer ar^ Individualized 
I^tructiofi," Science 166: 574-582, October 31, 1969. 

CLUE Staff. Working Papers. Ann Arbor: Center for Res^rch or; Learning 
and Teaching, University of Michigan, 1969. 



Feldhusen, John" and Szabo, Michael, (a) "The Advent of the Edticational Heart 
Transplant, Computer-Assisted Instruction: A Brief^Jfnterpretive Review/^' 
Contemporary Education , 40: April 1969. * ^ J 

Feldhusen, John, (b) 1a Poartion Paper on CAI Research and Development, Stanford: 
ERIC Clearinghouse for Educational Media and Technology, Stanford 
University, .1969.- 

Oilman, David Alan,. "Potentials of *CAI as a Research Medium for Educational 
Psychologists," Educational Psychologist > 6: May 1969. 

Glaser, Robert. "Psychological Questions in the Development of Computer-Assisted 
Instructiori." Learning Research and Development Center, University of <, 
Pittsburgh, 1969. 

/ r 
Hansen, Duncan; Dick Walter; ,and Lippert, Henry. "Annual Progress Report:. 

January 1, 1968 through December 3.1', 1968." Report No. 7. .Tallahassee: 

CAI Center, 'Florida State University, 1969. 

Holtzman, Wayne H. "Computer's and Education." Computer-Assisted Instruction , 
Testing and Guidance . (Edited by Wayne H. Holtzman.) New York: Harper 
and Row, 1570. 

Lykos, Peter. "After Token Academic Computer Use — Then What?" Educational 
Media, November, 1969, pp. 16-17. ^ 

McLaren, Peter. "Planning and Managing the R&D Programme." Paper presented 
at National Council for, Educational Technology Seminar on Computer-based 
Learning Systems, Leeds University, England, September 8-12, 1969. 



December 1970 



i 

I Project CLUE 



II 6 Research 



15 



Molnar, Andrew R. "The Frontiers of Computers in Society." ' Ps/per based on 
comments made as member of panel at Spring Joint Computer Confference of 
American Federation ' of Information Processing Socieittea, Atlantic City* 
New Jersey, May 2, 1968, " . / 

'Na^iional Council for Educational Technology, CNtET) . Computir-Based Learning 
Systems: A Ftogramme for Research and DevelopmeAt t ' Xohdorf: NCET, 1969.. 

Oettinger, Anthony and. Marks, Sema. '^Educational Technology: New Myths and 
Old Realities." Harvard Educational Review 38; 1697^717; Fall 1968. Adapted 
from Run Computer Run . Cambridge: Harvard University Press , 1969. 

Stolurow, Lawrence. "Computer-Assisted Instruction^ " The Schools and- the ^ 
Challenge of Innovation . New Yprk: McGraw-Hill, 1969, pp. 270-^319. (Also 
issued as Supplementary Paper 28 by Committee for Economic Development.^ 

Zinn, KarlL. (a) A Comparative Study of Languages for Programming Ii^teractive 
Uses of Computers in Instruction > Ann Arbor: Center for Research op. 
Learning and Teaching,, The University of Michigan, 1968. (Also Boston: 
EDUCOM, February, 1969.) 



Zinn, Karl L. (b) "Instructional Uses of Interactive Computer Systems," 
Datamation ,. September, 1968, pp. 22-27. 



Project CLUE 



December 1970 



. Documentation and Distribution of Information anM Learning Materials: 
A Statement of Positions and Points of View* \ 

\ 

I. ASSESSMENT OF CURRENT DISSEMINATION EFFORTS 

A. Information Levels and Needs -V 
Opinion about Information Services 

C. Role of Publishers and Manufacturers \ 

D. Specific Concerns 

1. Little incentive for documentation, distribution, and- revision 
.2, Need for information, review and evaluation t 
3, Copyright legislation 

II. GUIDELINES FOR BROADENING THE BASE OF USERS OF LEARNING MATERIALS 

A. Formalized Dissemination and Review ^^rocedures 

B. Incentives to the Author: Academic Credit, Protection, Reimbursement 

C. Expanded Role for Publishers, Manufacturers,' and Information Services 

D. Approaches for Documentation of Learning Materials 

E. Ne w - O rganizational Arrangements - . 

1. * Standardized curricula 

2. Centralization of resources and trminiug 

3. Computerized networks ' ^ 

III. A VIEW OF THE FUTURE 
IV. SOURCES 

These statements have been selected from published and unpublished literature 
to represent various points of viftw .concerning^ dissemination of useful 
information about computer-based learning* Most have been shortened and 
some altered to convey the intent in a few lines within the context of a 
larger outline, and to poitit out similarities and differences with related 
positions. 
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I. ASSESSMENT OF CORRENT DISSEMINATION EFFORTS 

^' Information Levels an d Needs; Recognize differences among users . 

Information may be described in terms of the level of confidence one has in it. 
At the highest level^ are results of investigations that have been published in 
refereed journals or by publishers with editors accepted in the. field of the 
investigation. The intermediate level i^cliides "published" technical repbrts,\ 
papers "read" at professional meetings, and preliminary results of studies underv^y 
transmitted among friends at prafessional meetings or on visits. The lowest level 
is only a hunch, or educated guess, which acquires confidence almost -entirely from 
the respect, tendeted the guesser. * 

The higher the confidence or credibility of information, the longer the 
delay in public announcement. Thus, the information in which "one places the " 
greatest confidence (in technical disciplines of rapid change) is most likely 
to have been superseded by the time i-t is known, although its successor is not 
yet available. . ■ , [Merrifield & Mood] 

♦ 

Three varieties of university-based researchers may be considered: the teacher- 
scholar, the professional researcher, and the student. The research interests 
and information needs of teacher-scholars tend to be either specific, with a 
component of immediacy, or vague, with a kind of .timeliness about them. Those 
of the professional researcher tend to be rather well^-structured and well- 
scheduled, with a strong component of interest in methodology £er se. The 
rpearch interests of the student tend to be vague with a yearning for a specific ' 
problem evidenced by concern for both methodology and the inclinations of his 

■ ■ [Merrifield. & Mood] " 

The professional researcher's need for hi^-conf idence Information is Immediate. 
Whether his frontier is in depth or near ^ periphery of his field, the pre- ' 
suppositions on w.jiph his study rests areAikely to be based on. fairly recent 
research by himself or others. The'need for early confirmation or rejection of 
these assumed foundations is apparent, if the research program is to be an 
efficient one. jB^o^^ Miller & Keenan] 
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B. Opinion . About/ Information Serv:fces: They . are quite variable , ' 

t 

Information and consulting resources which are currently accessible to the 
researcher and program developer fall into four discernible categories: 
1) private "not-f or-proMty partly subsidized* organizations (such as Entelek/ 
initially); 2) profit-making commercial organizations (e.g., ICAI, CAIS,ETC); 
3) university and government-supported services (such as ERIC Clearinghouse at 
Stanford and the Instructional Media Laboratory at the University of Wisconsin 
in Milwaukee); 4) i^iid:^vidual, specially-funded studies (e.g. , ''"Education in thfe 
70's.", RAND study on-Coraputers in Higher Education, and Project CLUE), [CLUE Staff] 



Results^ from a questionnaire sent to several project diYejctors throughout the 
country revealed that some groups either w^re not aware of or had not used 
certain of these resource categories • Findings alf.o tended to confirm general - " 
opinions expressed ir'-^rmally by pe'rsons engaged in CAI activities'. 1) university 
and governmeitt-supported clearinghouse's were, given the most favorable ratings. 
2), private "iio|:-for-prof 1^* partly suheidlzed organizations, and particularly 
the profit-making commercial services, were criticized for bein^ 

too expensive, material not current enough, inaccurate abstract^ing, too commercial 
lac. professional review, ^ ^ [CLUE Staff] 

The private sector of the economy has demonstrated its ability to respond quickly' 

to needs of the nation's educational institutions. Only the Private sectot has 

the institutionalized method-marketing fpr getting researcn translated' into practice. 

Non-profit educational institutions should be wary of trVing to v use tax-payer 

funds to organize non-profit service institutions from whichy purchases can be made. 

Frequently, their efforts are based upon the almost invariably erroneous assumption 

that a*-non-prof it organization subsidized .wit^i public f unds^ will furnish better 

• ~ I- ♦ # 

service cheaper than a profit-oriented organization. Such/ institutions should be 

established only when it is certain that th^ private sector will not meet a felt 

need. This is not the case in the. field of computer-assisted instruction, since 

private cc^panies already in being and those likely to be formed in the near future 



.will provide a wide proliferation of .service* for CAI, . 



December 1970 



(Kyle] 



Project CLUE 
V 



II 7 Documentation 

r 

At the present, there is little the publishers can market, although 
deal can be poured into research and developmen . To what end, tho 
difficult to envision bec^iuse of the lack of standardization of equipment. 
Publishers could develop supplemental \Vorkbooks" and the like to accompany 
learning ^exercises on a computer systenwir they were involved in some way 
with that kind of computer activity, e.g., wished to put in R&D money. 

^ [J. Wilson] 

The publisher's responsibility for information' about pilot projects will 
no doubt remain in its traditional form: publication of monographs, 
edited collections, of readings from journ/^ls, technical reports and 
unpublished documents, and books by individual authors describing in depth 
their experimental work. 

• • 

The major responsibility for dissemination of fully developed courses ' 
even though developed by computer will probably ^ remain *with major 'publishing 
houses. Editorial and sales functions, while iU-designed at present for 
CAl, will probably be easily adapted to their new roles. The major problem 
facing publishers is the implementation of a given program on a variety of 
hardware systems. Many n«. - techniques and a new channel of cooperation 
between publishers and hardware manufacturers must be developed .before the 
production and distribution problem can be solved. * [H. A. Wil£. .nj o 

It is impossible tor manufacturers to anticipate all needs of educational 
users, who in turn cannot specify all requirements until they become involved. 
An iuceractlve developmental cycle is thus implied. Mutual trust and 
cooperation between educators and manufacturers is complicated by the educator' 
open environment and tradition of free exchange of scientific data* contrasted 
to the manufacturer's concern for protecting' proprietary information, or 
releasing possible defective products too early. The new user* s group 
fpr IBM instructional systems should p^ove an important voice in bringing 
evolutionary development in CAI hardware,-^ at least for one vendor. [Bunderson], 
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D, Specific Concerns: Incentives, reviews and copyright protection 



1. Little incentive' for documentation, distribution, and revision. 

One, reason authors are npt interested in documenting compute r-brfsed exercises 

is the lack of standardization in computer systems; few others could use the 

product. More imparcant i^s the lack of institutional rewards (academic and 

economic) for such material. In spite of assurances at some schools that 

teaching and especially innovative curriculum development will be rewarded 

as much as research, academic admin Is t;rators continue to ignore 

instructional material i" determining promotions and salary increases, 

[Zinn] 

) 

Many professors initially enthusiastic about computer-based curriculum have 
later been discouraged , by the tedium of coding, testing, and revising them. 
On some occasions needed revisions have not been implemented because of the 
cost and elapsed time, as well as Umitations in the system and language, [Zinn] 

The high costs and low incentives encouraged by the original author of 
curriculum materials are even more serious factors for potential users who/ 
may wish to adapt the computer-based exercise somewhat for their own 
students and educational obj^ctivej. Documentation of computer programs is 
unavailable, and incentives for modification are small if the credit remains 
with the originator. The commercial system knows how to encourage an 
individual to prepare a useful second edition of someone else^s textbook, [Zinn] 

■ . /_ 

2. N^ed for inf oriiation, review and evaluation 

Many people are not aware of what others are doing in a related field. The«:e 
is an appalling lack of information about similar work, not only at the other 
end of the United States, but often in , the same, or neighbouring, state and 
even in one case on the same campus, indeed with the same department of the 
same campus, [McLaren] 
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Practically aVl the teaching material prepared for computer use has been done 
in such a way that one cannot readily take it over into a new situation. The 
project which produces only prog-ams is failing to fulfill its obligations to 
the world as a whole. Morw atlreution should be given to documenting such 
material so that others may decide if they wish to use It* (Bork] 

Results of a survey of researchers interested in edi^cation/-^ technology 
revealed that computers stand out ds one of three media (among eight possible 
choices) most in need of coverage, and priorities are for information about 
research/evaluation activities, use/cost factors, management of instruction, 
technology (hardware), and content of instruction, in that order. [Paisley] 

Unpublished literature dominates the ccmmunication among researchers and 
developers: conference papers, papers circulated only among the "in" group, 
reports "published", by research and development^^eaters , and military and 
industrial documents. The gain in speed of conffltunication among researchers 
accomplished by using unpublished materials carries two substantial hazards: 
1) material is not evaluated, and 2) communication is haphazard. [Ft-ldhusen] 

3, Pending copyright considerations 

Authors of CAI material have generally found it either Impossible or impractical 
to take advantage of property rights in the^ir products; moreove^, the legal 
•tatus of «n «««ily-copi«a progr«3 is not autirely clear. , (Sharpej 



The lack of an adequate and aeaningful revision ^ the U.S. copyright l«ir ii. 
an important factor Impeding d^elopment and distribution efforts. The present 
copyright law is 60 years old, and, though amended several times, it does 
not reflect the controls needed to protect the authors and publishers 
developing and adapting materials for contemporary forms iif pommunications 

\ [CLUE Staff] 

media. ~ ~ — . 
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A survey of professors using the computer for classroom Instruction at he 
university of Michigan indicates that sample materials and research findings 
are disseminated primarily through papers read at professional meetings and 
informally circulated among colleagues. Several professors expressed 
willingness to develop and document experimental computer-based learning 
exercises if professional journals and publishers showed more interest In 
disseminating th.m. Other difficulties cited were lack of time, lack of 
funds to hire assistants, and lack of interest in showing unevaluated materials 

(CLUE Staff^ ^ 

to others* ^ 

Authors of new-type instructional materials for computer systems that display 
acceptable originality will receive protection dn'any ultimate revision of the 
copyright laws. The greatest difficulties encountered in developing desirable 
revisions of the laws relate to the ease with which published materials, . 
including copyrighted materials, ■ can be duplicated by employing recently 
developed technological devices. This duplication may be carried out In a 
variety of ways, inauding, as a possibility, duplication in the memory unit 
of a computer. 

\ 

A proposed copyright law would restrict computer storage and processing of 
texts, although reasonable ways exist to provide suitable payment to the 
owners of texts stored in a computer whether it produces hard ■ copy or 
only an electronic display. Tne prospect is that some publishers, whether 
through lack of attention to a request or unbased fears about new technology, 
could legally restrict the availability of knowledge and its manipulation for 
a ■ [Zinn] 

further usee. 
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II. GUIDELINS€^ FOR BROADENING THE BASE OF USERS OF LEARNING MATERIALS 

( 

A. Formalize and Standardize Procedures of Journal Dissemination an(j Review 

Periodic critical review is needed from Various points of view* The 
occasional consideration in the Review of Educational Research , the Annual 
Review of Information Science and Technology , Computing Surveys , and other 
review publications should be made more regular and comprehensive ♦ Perhaps 
a special review of computers in education is ne^eded, from the point of view 
of educational technology* 

A few journals ar'^ publishing papers which contribute to the body gt research 
knowledge, techniques and successful applications: iunec^can Sducatlonaj 
Research Journal > Journal of Mucational Research , Educationa l Technology., and 
Xk>mmuaic&tioa8 of -the Association for Computing Machinery > 



1 



Dissemination and review of computer-based learning exercises should become 

associated with professional societies ' and discipline, grouping • For example, 
the American Journal of Physics publishes re fereei notes on instructional use 
of computers. . [CLUE Staff] 



B. Provide Better Incentives to^he Author; 
reimbursement """"^ 



Academic credit, protection 



It is most unlikely that the overall reward structure of the university 
community can be altered so dramatically that faculty members will begin to 
produce large amounts of CAI material with no further incentives • Administrators 
must lower the costs and/or increase the rewards to a professor for preparing 
learning materials • One means is to give CAI material greater generality and 
longevity. Another is to provide explicit and direct rewards to the author*^ 
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Some sort of academic credit should be extended to authors for producing 
innovative and useful computer-based learning materials. This couW be done 
by establishing regular reviewing an(| evaluating procedures in professional 
journals. Since contributions to his academic discipline are the chief 
determiners of a professional researcher's merit, the reviewing should be 
incorporated in disci{>line-oriented professional journals rather than 
education ioumals. [CLUE Staff ] 

Once the complexities of the problem have been resolved in the form of a 
suitable copyright law, the scholar>r using the computer as a tool, will 
benefit the more, in keeping with the time-honored American concept of 
favoring the public right of access over the author's monopoly* The 
scholar involved with the computer as author, along with his publisher, might ' 
appear to lose some of his control, but will ultimately benefit prof4ssionally 
and even financially from the broader use of his material as it is translated 
into media other than the printed word. , [McCartan] 



Providing economic motivation to the potential author of computer-based ^ 
learning materials has been unsuccessful* A whole industry is geared to v 
encouraging writing of books, but no corresponding means exists to reward 
the writing of a CAI course despite the fact that, like a good book ^. a good 
instructional progran can be u£'d by others than its author* A mechanism is 
.needed for collecting from the user — as from the performer of a musical 
composition — fees for use of original materials* [Gordon] 

• 

It is a relatively simple matter to modify a computer's operating system to 
account for the use of a program or set of data. Moreover, the originator 
can arrange to have his program or data used , by others but not copied or 
^t— Ined by them. • Thereby instructional progrwi and data baaaa can ba 
offered for* fees, with property right* reasonably well protactad. [Sharp*} 
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Greater effort rust be made to improve the quality and quantity of resources 
'Zva.lciblc to the re.rtiarcher from the clearinghouses aud publishers, particularly 
from the ^'not-for-profit" and commercial services. Possible activities 

to meet this need! indluder a conference to discuss ways to evaluate, document, 
and distribute coiaputer-based learning materials and literature describing 
research effortsjiand establishment of a pilot operation to demonstrate how an 
interuniversity f library" of such ma'terials and literature might operate, 

[CLUE Staff] 

1 

The R&D^,tequired to implement CAI and individualization widely and successfully 
prese^rtts a task ^ which requires close cooperation between un:|.versity laboratories 
and industry, in both hardware and software development* Relationships with 
pi&liahers in regard to instructional software will b€5t»»e more and more 
necessary to provide dissemination and standardization* [Bunderson] 

Along With the additional capability of the computer to add new dimensions .to 
traditional instructional materials comes an increased degree of complexity—^"" 
for the publisher. The skills required to produce good CAI materials do not 
necessarily reside within the publisher's current editorial and publ^ication 
staff. The flexibility and dynamic aspects Vf this new medium bring with 
the* additional manageaent and logistic considerations that are not now within 
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Coordination With Other Studies 

Throughout the project, CLUE staff members coo;:dinated their efforts with 
those of other projects reviewing the use of computers in education. Material 
and comment were exchanged with specific projects of similar purpose, among 
them: a study of the computer in higher education at Rand Corporation, Santa 
Monica, California, " for the Kerr Commission on Higher Education; a survey of 
computer uses in college teaching with a demonstration of an innovative 
system at the Sloan School of Managemen^t, MIT, Cambridge; program planning by 
the National Council for Educational Technology, London; and other projects 
discussed at numerous single conferences and symposia. CLUE staff members 
helped prepare materials for several conferences and publications^ thus 
contributing to the other projects and at the same time obtaining useful 
comment from the audiences for use in revision of the document of Project 
CLUE. 



ERIC 



For examp,l'4, CLUE prepared a package of materials for participants in the 
National Council of Educational Technology's Seminar on Computers in Education 
held in L2?ds, England, September 8-12, 1969. With revisions, some of these 
materials were published in the conference procedings. Other significant / 
contributions of Project CLUE to working conferees iticlude: a workshop ybn 
■ ■ M . . I i iluM l4a of eomDutero to Uamina a^ci rAprMnVgf f^iP ^"11 ' ^'^^T^t 0?TnrMt<'f 



[Bacon] 



D, Guidelines tor Documentation of Learning Materials: Excerpts from one set 
of recommendations 



n 



Each group of users can benefit if it adapts and evaluates the materials of 
others, and has its own materials tried on other systems. Translation of 
materials and instructional strategies can be facilitated by a common notation 
and other conventions for documentation. 

" In most cases the. essential information about a computer-based learning 
exercise can be derived without executing the program; careful study of proper 
documentation should provide all information about the 'materials and logic ^ 
short of operating system characteristics. It is often more efficient to ' 
obtain relevant information through organized exploration of the program 
description than through reading individual records of student-machine 
interaction or through blind searching on-line at a student station for the 
eventualities for which che author has provided coding. Ho-zever, number of 
approaches are mentione'i below: ^ 

Special notations-. A variety of information processing functions are 
placed under author control in languages for programming computer-based 
learning exercises. Any general notation should be convenient for 
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Dissemination and Qthtr Service Activities of Project CLUE 

lliroughout the project, the staff of Project CLUL pursued activities believed 
to be useful at the moment to po^,t:ntial users of computers in instruction* 
Thus useful information was made available previous to and apart from dis- 
tribution of drafts of the final report. ^ 

As noted earlier, the project exchanged materials and ideas with a number of 
other projects, providing direct assistance to some of them. For example, a 
'set of project abstracts was prepared for the work at RAND Corporation, and 
a draft of a statement of domain and dimensions of computer use. RAND staff 
built upon this work and returned their drafts which were of benefit to further 
writing within Project CLUE. ^ 



ERIC i 



The files of Project CLUE Were open to all who inquired. The files included 
materials on author languages, student lan^ages, abstracts of projects, 
selected review papers and technical reports from each project. Other files 
concerned special areas such as generative technique and dissemination of 
information • Inese were reviewed by a number of visitors who came to the 
Center for various purposes and utilized the CLUE files: they found available 
there, and also by University of Michigan faculty and students. Six of the 
vi^l'torc r a m^ r^^^^^"^^^^y ^^"^ r>flrpfii1 search of the literature files and 
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ir«prM«ntinf all of these aspects. Although it is possible to represent 
teaching logics or training patterns in existing flow chart notations, such 

diagraznming is less convenient than it: might be* Some simple instruction , ] 

» 

processes require greater volume of charting than ahould be necessaiy for 
Author purposes; some standard symbols have little mnemonic value In 
fthis particular application of computers. Some functions, unique to educational 
and interactive applications require special symbols if lengthy explanations 
are to be avoided. 

Content summary : The usual way to describe a textbook chapter or 
programmed unit is to provide a brief listing of what it "covers", e.g», 
McDougdl^'s laws. This general information can be useful, especially to 
subject experts who have mt^h experience with the textbooks and conventional 
procedures, for presentation in a' particular area. Kowever, if a decision 
to use certain materials is being ma^e care'fully, ituch more detail is' needed* 
First, it should be determined what reqtilsite skills and knowledge are assumed 
of the student when he begins the learning exercise. Secondly, the central 
concern is what the student is actually able to do differently at the end of 
instruction. Third, suggestions are needed for how the m&terials are t 

best used to achieve the goals, and how secondary goals not explicitly sought 
by the author may be affetted. 

Records of intei?1action ; Listings of the Interaction or * conversation a 
"typical" student may have with a computer program have been published to 
convey Information about instructional programs. A nun^er of shortcomings are 
ap]^arent: one is often left wondering what would have happened Kad the student 
said something else. More specifically, one cannot be sure whether an 
apparently appropriate computer ^ response was provided by chance or 
actually resulted from a recognition of the student answer or request. Finally, 
one would have to read a large number of such transcripts In order to gain 
very much information about the full extent of content and logic In the 
ifistructional tmlt. However, a record* of interaction can present a 

realistic sample of how the program actually does perform, and it emphaalMs 
for th« rmmdrnt thm contimiity of eoBwc««ti<m cdgiit hm mdUmttA iNLtk m 
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Tq take /full advantage of this .technique, footnotes or marginal remarks 
should be \i/ed throughout to indicate alternative treatment that might 
have beey given this^ student had his response been otherwise. The annotator 
should indicate what part of a response was recognized and processed by the 
comput/er. More than one transcript of Interaction with .a program should 

be presented, and each shou3^ be selected to represent another type of 
student or learning situation. 

7 If the single purpose of documentation is to communicate information 
about one's material and logic, transcripts could be simulated from a detailed 
f^ow chart of the interaction. That is, the samples would be designed to best 
r<xi5resent interactions for which the author has provided cording. 

On-line experience : Actual experience with a computer-delivered exercise 
ma^^^feB an important contribution to understanding and evaluating an 
instruc«<iix§l unit, especially if certain knowledge and techniques are 

supposed to un^^ld or develop during the learning experience. An important 
component of some >jeaming experiences is affective, i.e., success 
depends on an impression or feeling of pleasure, satisfaction or possibly* * 
surprise. Negative experiences might also be identified in on-line experience 
more readily^han in a statement of specifications. For example^ the delay 
in response time is a complicated function of the student*^ thinking tin* mmA 
the magnitude of the job he believes he has given the computer. Infonwition 
about the length of time students must wfdt, e.g., average reply time of 2.6 
seconds with under 10% exceeding 5.0 seconds, is not as impressive as actually 
having to wait various periods of time, including some long delays. Problems 
with keyboard input perhaps have affective components not readily described, 
such as the frustration of trying to represent a mathematical equation or a 
diagram in a manner which can be interpreted through a keyboard connected to 
the computer. 

* In general, on-line experience is not a practical way to obtain information 
about computer-based learning exercises^ it requires more time of the reviewer, 
transportability of materials, etc. However, first-hand use provide© a context 
within which the ^valuator can then place vicarious experiences obtained 
through tlia ott^r aumiDary techniques <laacriba4 abova. [Zlsm] 
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New Organizational Arrangements: Collection, distribution and exchange 

1. -Standardized curricula 
> 

A factor that may overshadow technological considerations as a determinant of 
software cost is the evolution of institutional arrangements for software 
production ana distribution. As long as CAI material is to be produced 

by individual professors for their individual courses at each institution, 
software cost will represent a high proportion of the total' system cost of 
CAI; each lesson wi/11 be.use'd by only a relatively small nuihber of students. 
If it becomes possible to standardize some aspects of higher education 
curricula to ^he- extent that CAT material can be used by numerous institutions, 
'then the average cost of software per student pir year can be subfitantially 
reduced, [Barro] 

^Hajor institutional changes may be needed if CAI teaching is to take over the 
' major burden of instruction in a subject. The professor can no longer be the 
proprietor of "his" course; computer-based instruction might become a service 
provided by an academic department, taken by students on a "contract" basis 
at their convenience, or prescribed for completion at or before some specified 
poiiit in the curriculmn. A new style of academic organization would probably 
be reqiiired to administer such forms of Instruction. [Barro] 

New organizatic«ial arrangeisents are needed to stimulate and facilitate software 

production. A number of possibilities have been discussed, ranging from 
procedures simitar to those in book publishing, whereby financial incentives 
are pravided to authors of instructional programs, to development of independent 
organizations specifically for production of instructional software. iHe 
future shape of the "instructional 'software industry" may have a significant 
effect on software cost perVtudent hour. [Barro] 
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2. Centralization of Resources and Training 

/ 

In order to diffuse common practices for documentation, programming procedures, 
instructional strategies, etc., some kind of professional library and perhaps 
a central resource for development' of computer-based learning exercises could 
be established. If authors from individual institutions were encouraged to 
come to one or a small number of sites to develop materials in a particular 
kscipline area, the facilities and personnel- there would" encourage certain 
accepted tecnniques for implementation- and doct^ntation of learning ^exercises . 

Independent research efforts would continue to e'xplore new techniques which,, 
when validated, would feed into the regional or national centers. Some 
arrangement such as this is needed to focus attention on those languages and, 
techniques whldT^ve successful -for large numbers of users in various 

. - " \ , ' * (aUE Staff] 

disctl>liTie areas. ' * 

Carefully ^i^nned^issemination projects could facilitate the diatribution ^f 
instructional materials and strategies beyond the individual projects ^d 
computer systems ^with vfhich they were developed. Probably organized within 
disciplines, such activity would include -a combination of conferencei, working 
meetings and a newsletter or other publication to promote trans? atability of 
learning exercises from one language and system to another. (Ztnti] 

3. Co!iH>^t:erized networks 

The potential utility ^fco-puterlzed networks seeM to be most significant 
for the p.rofessional^researcher requiring faster access tos^formation in which 
he has coiSid^ric^then is presently possible through refereeVjournals. The 
result of kch prompt dlsse.iaation of recant reaearch findinjs or .ngoing 
experi-enia .m|ght be norey opportunity for fruitful diicusiilon. iMerrifialil 

'4 ' ' 
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Although access problems are"^>^able of solution by a computerized network, 
thevalue of immediacy to all butthe professional researcher s^ems relatively 
unsubstantiated. , ^ / [M»rrifield k Moodl 

j - 

The simultaneity offered by an inter-institutional computerized network might 
'remove the often artificial controls that limit the generality of research, while 
at the same time providing the corroboration of experts that is now approximated'^ 
by the replication of studies. {Merrifleld 4 Hood] 



Immediate dissemination of refereed and edited manuscripts would be very 

helpful to the professional researcher, and perhaps necessary to the continued 
acceleration of research. Any early abstracting service coupled with 
computerized dissemination would be worthwhile. No doubt such dissemination 

would have to be conditioned on a royalty scheme or some kind of guarantee of 

1 

economic and professional credit* ^ 

Further, the professional researcher could be presented, automatically, 
with information, perhaps abstracted, for which his research area is only a 
secondary descriptor. New fields grow from unions of fringe areas, as has 
been frequently demonstrated. The need for this kind of information is 
perhaps not so urgent as to warrant its entry on an electronic channel; the 
function of a computerized network here is not so much speedy dissemination as 
comprehensive culling. The activities of ERIC along thls*line are promising. 

fMerrifield & Mood] 



Project CLUE December 1970 



18 



II 7 Documentation 



III. A VIEW OF THE FUTURE 



The industry for producing, mai?keting" and distributing CM material to colleges 
and universities will develop much as the textbook industry has. 

College faculty members, working individually or in groups, will produce 
instructional programs. The initial impetus and the testing-ground for these 
programs will be provided by th^ faculty members' courses. Few authors will 
invest significant amounts of time* and money, at the risk of not having their 
materials accepted for use, so it is expected that development costs will for 
the most part be charged to the university, 

. Compensation typically will be on'.a royalty basis, and an author will 
want to work with a firm that * can market -his material efficiently. Risk-sharing 
and compensation probably will differ little from the arrangements currently 
used for textbooks. ^ 

Traditional publishers will take on the editorial and marketing function. 
Procurement editors can be Xrained to solicit marketable CAT material. It 
will cost less to add CAI products to the. l^ne of educational materials 
already handled by the publishers , than te^pfovide an entirely new set o_£ 
channels for soliciting potential i>roducers, procuring markets,' and 
distributing materials. 

Material will be distributed on commercial time-shared services. Some 
services wiil provide low-cost storage, ^omd low-cost ^omputing, and others 
low cos't input and output. The firm which solicits, revises, and markets- 
material does not need also to provide the computer services on which the 
• material is made available. Material will be offered at premium rates> with 
the'premium split between ^he publisher and the author.. ^ 
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Terminal equipment often will be provided by the college or. university;^ 

i 

however, the students will be expected to bear most (if not all) of the costs 
of using CAI material?. For *^xample, a coin slot on terminal equipmer could 
be used in much the same way that coin-operated typewriters (usually in the • 
library) are used by students today. A coin deposited by a student would send 
a special bit pattern over the line. The computer service would then increase 
the student's account balance, and he could use the system as long as his 
balance remained positive. 

CAI materials will liave to survive competition with textbooks. The 
student will have the option to economize on computer use or to avoid the 
costly machine entirely by depending on alternate materials. The industry 
for CAI materi-al will develop only to the extent that buyers are convinced 
of real ^ advantages, over conventional published material. 

Some CAI mate'rials will compete with instructors as well as printed 
material.- Traditionally, additionalginstruction is provided free of extra 
cost, thus encouraging rather substantial use by students. If the same 
strategy were adopted towards costing use of equivalent CAI material, 
peers and administrators would have to determine the relative worth- of 
ChI vis-a-via traditional instruction. [Sharpe] 
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" ■ VOLUME il - APPENDIX A 

CONDUCT OF STUDY: PROCEDURE, COORDINATION, DISSEhflNATION/ 

W abbreviated description of the project is given here to inform the 
interested reader about the procedures used to collect ai^d interpret 
infonnation, the coordination with other review projects, ^d tne dissem- 
ination of tentative findings and supporting infonnation 'during the project 
itself. ■ - , 

I 

» 
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II App A Procedures 
.rief History of the Project 

A framework for discussion and recoTumendation was extracted from primary 
sources during the early months of Project CLUE (January through March, 1969): 
Staff members searched for current and relevant materials^ in order to inter- 
pret what was being done, what had been planned, and what was judged to be 
most needed and important. The survey was aided by suggestions from con- ^ 
sultants received by mail and telephone. 

Inform^ation obtained in the survey was organized into readily accessible 
fil^s^^for use by interested partficipants • Materials continued to be accum- 
ulatfed from a number of sources,* although most of the work was done during 
.thq' spring of 1969. J^roject^ directors aad-persons active in research and 
development responded to requests for pertinent materials relating to their 
current work. Staff members visited sites of particular interest and attended 
meetings and conferences. Notes of numerous phone conversations and tape- 
recorded discussions werc- transcribed and reviewed. Staff members continued 
,to check current issues^ of professional journals, magazines, and newsletter - 
bulletins as well as books and unpublished manuscrip^ts f^r new sources. 
Periodically, news releases and notes on controversial issues were published 
in an effort to' evoke reaction and obtain contributions from interested readers 

During summer and fall, the CLUE staff assembled from th^e published and 
unpublished sources, five documents containing differing points of view- on 
issues in the use of computers in education. Most of the individual state- 
ments within each collection wer^ shortened to sharpen the meaning and some 
were altered to make^them clear 'when read outside the context of the articles 
from* which they were taken* 
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Review by Those Whose Material was Paraphrased 

* M t 

Drafts of five statements of points of view were assembled 'during the s.jmmer 
and m'ailed to all persons quoted directly and to other interested and know- 
ledgeable specialists in the field. Revisions were made by CLUE staff during 
the fall and winter based upon comments and criticism received from these 
participants. Vocal expression of opinion was collected at a symposium of 
the National Council for Education Technology (United Kingdom) and at small 
discussion groups assembled at meetings of computer, engineering ahd 
educational groups in the United States. A preliminary draft cf the entire 
final report was distributed for review and, coranent in Februar>-, 1970, and 
the preliminary, findings were discussed by c^ics called by Project CLUE to 
a special '-session at the annual meeting of the American Educational Research 
Association (AERA) in Minneapolis, March 2, 1970. 

The next sefies of revisions &nd updating of the preliminary draft was made 
during March and April with additional review at meetings of the Association 
for Educational Data Systems (AEDS) and the American Federation of Information 
Processing Societies (AFIPS) . The appendices were prepared during the spring 
and summer and distributed for comment. Several articles summarizing sig- 
nificant findings for publication to wider audiences were completed during 
the summer. A draft of the final report was presented M the project director 
to a special conference on Computers in Education sponsored by the International 
•Federation for Information Processing (IFIP) in Amsterdam in August 1970, and 
the Education Sector of the annual meeting of the Association for Computing 
Machinery (AG-i) in September in New York City. Based on discusision of these 
meetings and others throughout the fall, the report was revved and extended. 
Copies of the entire final report will be available through the U. S. Office 
of Education and the ERIC Clearinghouse on Educational Media and Technology 
at Stanford University. Some sections will be revised &nd distributed by 
The Center for Research on Learning and Teaching at the University of 
Michigan, for example, the Guide to Inforfejatlon Sources (Appendix A of Volume I)'. 
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Early in the project a auick version of the longer review was produced and , 
distributed through the ERIC Clearinghouse on Educational Media, Project 
CLUE staff obtained particujLarly helpful contributions from Robert Morgan at 
Florida State Universi.ty.'and John Feldhusen at Purdue University which were 
edited and assembled with other materials for distribution by ERIC. 

Project CLUE staff also^'encouraged individuals to participate in meetings 
such as the Seminar on. Computer-Based Learning sponsored by the National 
Council of Educational Technology. E*N. Adams prepared a paper on languages 
and systems; Gordon Lyon assembled notes on computer system design; Robert 
Seidel interpreted some of his work on economics and management. A detailed 
list of various contributions follows. 
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Professional Meetings and Associated P roject CLUE Papers and Publications 

During the study, staff members attended a number of professional meetings . 
to share the study's findings and to receive suggestions and contributions 
from specialists in diverse fields' related to educational technology. Such 
trips and presentations alsD further the goal of. early dissemination of 
tentative results and supporting information. 

The following list provides a summapr of the most significant meetings 
attended by CLUE staff throughout the project. The date and place of each 
meeting have been noted, topics of primary concern are indicated, and relevant 
publications or papers presented at the meetings have been identified. 

American Educational Research Association (AERA) 
Annual Meeting 

Los Angeles, Calif ojnla, February 3-10, 1969 

"Instructional Programming Languages: A Five Year Perspective, " 
since published in Educational Technology . Vol. 10, No. 3, March, 
1970, pp. 41-43. \ . ^ 

Entelek . . 

Midwest Conference on CAI* ^ - ' 

Chicago, Illinois, February 4, 1969 

"PurpKSiies and Plans of Project CLUE" (Handout) 

Association for Educational Data Systems (AEDS) 
Convention 

Portland, Oregon, Hay 10-13, 1969 

American Federation of Information Processing Societies (AFIPS) 

Spring Joint Computer Conference ,(SJCC) 
Boston, Massachusetts, May 13-17, 1969 

"Computer aids to learning about computing" (Disc^sion topic) 

n u ■ -icinn • ' Project CLUE 
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Association for Computing Machinery (ACM) 
Annual Convention 

Challenges of Progress in Computing: People, Technology, Purposes 
^ San Francisco, California, August 26--28, 19^^ 



* i 



Organized for round table discussions on computer science topics 
bearing on instructional uses of computing; project CLUE handouts used. 



Institute of Electrical and Electronic Engineers (IEEE) 

InternatioQal Symposium on Man-Machine Systems , (ISMMS) St. John's College 
Cambridge, England, September 6-11, 1969 

"Interactive Programming Languages Adapted for Instructional U5e of 
Computers," with John C. Hesselbart. Proceedings of the First 
International Symposium on Man-Machine Systems 1969 , Cambridge, England, 
1970 

National Council for Educational Technology (NCET) 

Seminar on Computer-Based Learning Systems, Leeds University 
London,- England, September 8-12, 1969 

"Planning and Managing the R&D Programme: A Summary of, Discussion," 
pp 89-93 in Proceedings of a Seminar oft Computer-Based Learni ng Systems 
in' Education , John Annett and John Duke (Eds.)- London: National Council 
• for Educational Technology. 1970, Distributed by Books for Schools, Ltd., 
tkrough CoMncils and Education Press, Ltd., 10 Queen -Ann" Street, London 
.wfmb.-Etigland. "A Comparison of' Languages" for Programiid,ng Inte.ractiye 
Use of Computers in Instruction." 26-31 in Proceedings. 

"Some procedural language elements useful in an instructional environment, 
with Gordon Lyon, pp. 18-25 in Proceedings. 



Institute of Electrical and Electronic Engineers (IEEE) 

Systems Science and Cybernetics Group (SS & C) 
Annual Conference 

Philadelphia, Pennsylvania, October -21-25, 1969 . 
. "Analysis of Computer Role in Learning and Scholarly Work" (Discussion, topic) 

I 
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Americans Federation of Information Processing Societies (AFIP) 

Fall Joint Computer Confererrce (FJCC) 
Las Vegas, Nevada, November 18-20, 1969 

"Computer Contributions to Learning and Performance: An Outline," 
Prepared for four concurrent, discussions and revised for publication, 
pp, 6-12 laterface. Vol 4, No, 1, February, 1970 

National Academy of Lagineering (NAE) 

National Academy of Engineering, Instructional Technology Committee 

Commission on Education 

Newark, New Jersey, November 24, 1969 

"Broadening the Base of Users of Effective Computer-Pvelated Learning 
Materials " .(Written recommendation* to committee) 

American Education Research Association (AERA) 
Annual Meeting 

Minneapolis, Minnesota, March 2-5, 1970 

"Preliminary Draft of Project CLUE Report" (Detailed handout) 

Organization for Economic Cooperation and Development (OECD) 
Centre for Education Research' and Innovation (CERI) 

Symposium on Computers in Secondary Schools 
Parii, Fra^ce, March 9-13, 1970 

"Implications of on-line systems for an introduction to computer 
--applications and programming," in presented at a Seminar on Computer 
Sciences in Secondary Education, Cen^:re for Educational Research and 
.Innovation, OECD, Paris. 



-Unesco 



Consultation on CAI in Developing Countries 
Paris, France, March 16-18, 1970 

"Guidelines for Instructional Use of Computers" (Project CLUE handout 
consultation report) 
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Organization for Economic Cooperation and Development (OECD/PARIS) 

Symposium, on Computers in Higher Education 
Paris, France, March 19-20, 1970 

"Requirements for programming languages in cocnputer-based instructional 
systems," presented at a Seminar on Computers in Higher Education Centre 
fot Educational Research and Innovation, OECD, Paris 16 (published by 
OECD, 1971) . 

ft 

City University of New York (CUNY) 

Conference on Computers in Education 
Princeton, New Jersey, April" 17-19, 1970 

"Introduction to Instructional Use of Compu 



and a View of the Future^' (Project -CLUE hafndout) ^ 

^ ^. / 



National Education Association* (NEA) ^ 
Department of Audip Visual Instruction (DAVI) 



: I^efinition of Concepts 



Annual Conference 

Detroit, Michigan, April 28, 1970 



r 

"Computers in Education: A View of the ?umire ** (Project CLUE hando^ 

American Federation of Information Processing Societies (AFIP) 

Spring Joint Computer Conference, (SJCC) t 
Atlantic City, New Jersey, May 5-7, 1970 ' 

"Computers in Education: Mechanizing Humans or Humanizing Machines" 
^ (pa^el discussion summary)/ Published as "Four Viewpoints on J^f --^^-^1,^^^; 
of Computers,'^ in IE EE Transactions on Man-Ma chine Systems, Vol. MMM-11, No. 4 

December 1970* 
Association for Educational Data Systems (AEDS) 

Annua; Convention: Education through Technology 
Miami, Florida, May 13-15, 1970 



fj 



National Science Foundation (NSF) 

Conference on Computers in the Undergraduate Curricula 
University of Iowa, Iowa City, Iowa. June 16-18, 1970 



Project CLUE 



December 1970 
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INDICOM ^ . ' - ...>^^ • 

-NaCtonal Conference on Computer Applications to'-^Leaming • 
/waterford Comn\unity Schools^ Pro ject It'inic'O.'^ * 
; Bloomfield Hills, Michigan, July 8-10, i970 ' . 

"Tentative Findings of Project CLOE in Lhe area of programming langiiages"' 



ESC 



Proceedings in pres.s. 



Engineering Summei; Conferences 
^University of Michigan 
Ann ^bor, Michigan, Summer, 1970 

''Sample ProgramsToT^Ins-tom^tional Use hi Computers" (Demons 




Commission on College Physics (CCP) . 

Conference on Computers in Undergraduate ^cfience Education 
Chicago, Illinois, August 17-21, 1970.--^" ^ • * 



/ 



"Computers in Physics ^and Mathematics Instruction: Capabilities^ arid 
Limitations," in Proceedings of a Conference on Computers in Uildergradu^t 



Sci-ence Education , Commission on College Physics, College Park 
Harylan-',, 1971* 

International Federation for Information Processing (IFIP^ 

' ■ It 
World Conference on Computer Education 
Amsterdam, Netherlands, August 24-28, 1970, 

"Instructional use of. computers: A critical examination with recommendations 
for action," with'-Susan McClintock in World Conference on Computer Education 
1970, R/ Scheepmaker and K. Zlnn (Eds*), International Federation for 
Information Processing, Amsterdam, The .Netherlands > 1971. '"General 
Report" also rept'inte I in lAG Journal , Vol. 4, No. 4j 1971. 

/ ^ . ' 

Institution of Electrical Engineers (lEE) / 

* Conference on Man-Computer Interaction 

Teddington,^ England, September 1, 1970 ' - . 

"Programming Languages and Operating Systems for Specific Instructional 
Environments," with James W* Conklin, in the Proceedings of the First 
International Conference on Man-Machine Interaction , Institute of 
. Electrical Engineering, Savoy Place, London, W,C,2, England, 1970* 

December 1970 " Project. CLUE 



u 



i 



II App A Procedures 

Association for Computing MachLnery (ACM) 

Annual Conference, Sect6r on Computers and Education 

New York Cicy, New York, September 2-4, 1970 _ \^ 

"A .Review of Computer Uses for Instruction: 'Report on Project CLUE/* 
* ^ To be published in the x^ducation Sector of the E.oceedings, 1971. 

,-^rmlssion on Higher Education, Carnegie Foundation 

Conference oYi Computers in Higher Education 
^ - RAND Corporation 

' ^Beverly Hills, California, October 1-3, 1970 ^ ' j - 

"Computer Learning Under Evaluation (Project CUE), and an Attempt at 
Hyp^,-cp,.orh.'.' in Computers in Inst ruction: Their Future for Higher 
Education , Rand Corporation, 1971. 

Organisation for ^Economic Cooperation and Development, 

Conference on Computei:s in Higher Education 

Center for Educational Research' and Evaluation (OECD) 

Portland, Oregon,' OctoBer 26-30, 1970- 
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4 • 
"Software Problems in Using Computers for Instruction. " and o.ther contributions to 
Conference summary and reco^.aiendations, published by* OECD, 1971, 



Institute of Electrical and Electronic Engineers (IEEE) 

* 

1970 Symposium oTi^Man Machine Systems 
Winter Park. Florida, November 12-13, 1970 

"Ah Instructional Environment for Interactive Problem Solving Using 
computers." (Project CLUE handout) 

American Federation of Information Processing Societies (AFIPS) 

Fail 'Joint Computer Conference (FJCC) 
Housto^ Texas, November 17-19, 1970, 

^ "Col^uter-^ in Higher Education/^-^ (Project CLUE handout) 



. ^ ^TTtP , December 1970 

f rojeot CLUE , , - . 
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VOLUME II - APPENDIX B 

LIST OF PROJECTS CONTACTED 

Names and addresses are listed for about 200 projects or offices in universities » 
schools, government, military, and industry in North America and a few university 
projects in other countries* All of the organizations ^^ere informed about the 
progress of ti e sttidy. Most provided ioformatlon about theilr activities and ^ 
CLUK staff worked ^loseiy with some of tne individuals and organizations listed* 

The list is intended to inform the reader about the scope of contacts made 
during the CLUE study. It may be useful' as a mailing list for distribution of. 
material but should not be considered as a list of sources to write fior general 
information. For guidance in an initial searca, the reader is directed to 
Appendix A of Volume I which describes information sources such as reference ^ 
books, periodical publications , professional organizations and^oramercial services 
which meet a variety of needs for information* 

The reader interested in instructional uses within a particular subject area 
should consult the discipline-oriented section of Appendix A in Volume I to 
determine the professional societies and commissions which were contacted in 
the course of the study* • 

CONTENTS 

I. University-based Research and Development 

A. General Projects 2 , 

B. Inter-university Projects 11 

C. NSF Regional Computer Projects 11 

II* Other Research and' Development 

A* Non-profit 1^ 

B. Mili'tary 15 

C. Commercial 17 \ 

III. Secondary School Applications 20 

IV. Information and Computer Serviqes 

'A. Commercial^ Services 24 
3. University and Non-profit Services 26 

r 

V. Asian and European Projects .^^28 
VI. Government Agencies ai?d^ Commissions in North America 33 * ^ 

VII. Addendum '35 

Audress comments to: ic-v-i l. Zinn, Director 

Project CLUE 

109 East Madison' 
Ann Arbor, Michigan 

Project CLUE December 1970 
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II App B List of Projects 



I, University-based Research and Development 
A. Gv^neral Projects 

1. Dr. Steven Hunka, Director ALBERTA 
Division of Educational Research Services 

University of Alberta 

9th Floor, Education Building 

Edmonton 7, Alberta, Canada (A03) A32-5762 

2, Dr. Miciiael A J Hall, Director BELOIT 
Social Sciences Instructional Programming Project 
Beloit College 

Beloit, Wisconsin 535.11 



Mr\ Melvin Ferentz, Director 
CAIvResearch Center 
Brooklyn College 

Brooklyn, New York 11210 (212) 



BROOKLYN 



780-5271 



A* Dr, M, E, Maron, Deplity Director 
Institute of Library Research 
University of California at Berkeley 
Berkeley, Calif oprnia 9A020 

5. Mr, Robert M, Gordon, Director 
Computer Facilities / 
University of Californiyat Irvine 
Irvine, California 92650 (714) 833-6540 

6. Dr. Wii: i*-m T. "Blessum, Director 
Califo^^nia College of Medicine 
University of California at Irvine 
1721 Griffin Avenue 

Los Angeles, Calif ornia\90031 

7. Dr. John A. Starkweather, Director 

(on Jeave 70-71) 
Dr, Martin Kamp, Acting^Irrector 
Office of Information Systems and Computer Center 
University of California 

San Erancisco, California 94122 (415) 666-2012 



CALIFORNIA/BERKELEY 



CALIFORNIA/IRVINE/CF ' 



CALIFORNIA/IRVINE/MED 



CALIFORNIA/SAN FKAN/MED 



Project \lUE 



December 1970 
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8, ^ Mr, Charlfc?s R, Luepkey, Diiector 

Computer Center 

University of California at Santa Barbara 

Santa Barbara, California 93106 
1 

9. Robert L. Ciaburri and 

Mitchull P, Lichtenberg, Directors 
Kducation Systems Research Project 
Baker Iiall 240 
Ciirnegie Mellon Lniversity 
Scheniey Pdrk 

Pittsburgh, Pennsylvania 15213 

10. - Dr. Donald Super 

^Computer A^sistec' .idance Project 
Teacbers Colleg4 
Columbia University 
525 West 120th Street 
New York, New York 10027 

11. Dr. Robert S. Tannenbaum 

Coordinator of Computer Assisted Instruction 
Research and Demonstration Center £o^ 

El ication of Handicapped Children 
Teachers Coll^^ge 
Columbia University 
525 West 120th Street 
New York, New York 10027 

12. Dr. Benjamin Rosner, University Dean 
City University of New York, CUNY 
535 East Eight leth Street 
New York, New York 10021 

13. Dr. Thomas E. Kurtz, Director 
Kiewit Computation Center 
Dartmouth College 
Hanover, New Hampshire 03755 

14. Dr. Edmund D^ Meye/s, Jr., Director 
Project IMPRESS 
Dartmouth College 
Hanover, New Hampshire 03755 



CALIFORNIA/ SANTA BARBARA 



CARNEGIE MELLON/ESRP 



COLU!dBIA/CAGF 



C0Lm4PIA./CAI 



CUNY 



DARTMOUTH/CC 



DARTMOUTH/IMPRESS 



Project CLUE 



December 1970 
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15. 



16. 



17. 



18. 



39. 



20.. 



21* 



22. 



Dr. John Schurdak, Director 

Educational Research and Development Division 

Fairfield^ University 

North benson Road 

Fairfield, Connecticut 06430 



FAIRFIELD 



FSU/CRICISAM 



Dr. Dunc^^n Hansen, Director FSU/CAI 
Center for Computer -Assisted Instruction 
Tully Building 
FiorLda State University. 

Tallahassee, Florida 32306 (90A) 599-3285 

Dr. GuenteT Schwarz, Director 
Center for Research in College Instruction of 

Science and Mathematics (CRICISAM) 
212 Diffenbaugl), 
FlorB^-. State ^^niversity 
Tallahassee^ Florida 32306 ^ 

Dr. Lawrence M. Stolufovrp-Director 
CAI Laboratory 
Harvard University 
8 Prescott Street- 
Cambridge, Massachusetts .02138 (6x7) 493-4282 

Dr* David V. Tiedeman, Director (on leave 70-71) HARVARD/ISVD 
Information System for Vocational Decisions 
Longfellow Hall 

Harvard Graduate School of Education* 
Cambridge, Massachusetts 02138 



HARVARD /CAI 



Dr, Anthony G.^Oettinger 

The Aiken Coipputation Laboratory 

Division of Engineering and Applied Physics 

Harvard University 

Cambridge, Massachusetts 02138 

Mr. Arnold^^Sehildkiet 

Hostos Community CdTie^e 

260 East 161st Street (9th' floor) 

Bronx, New York 10451 ' 

Dr. Donald Bitzer, Director 

Computer-based Education Research Laboratory 

University of Illinois 

Utbana, Illinois 61801 iMD 333-1138 



H;JIVARD/CAIR 



MOSTOS 



ILLINOIS /CERL 



Project CLUE 



December 1970 
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2J. 



1/ , 



25, 



26. 



27, 



28, 



Dr. George L. Miller, Director 

Offici' of R*>search in Medical Education 

P.O. Box 6998 

Clucago, 1 1 iinuis 60680 

Dr. Arthur Babick 

Learning Systems 'lochnolugy Program 
Division of Educational Media 
bcliool of Education 
University' of Indiana 
Bloomington , I ndiana 



ILLINOIS /MED 



INDIANA 



47401 



Jr. David Al Ciin».^n 

Coordinator ui Media and Technology 

21 Stalker Hail 

Indiana State University 

Terre Haute, Indiana 47809 

Dr. R. J. Munn, Director 
Institute for Molecular Ittysics 
Department of Chemistry 
University of Maryland 
College P^rk, Maryland 20742 

Dr, William F. Atchison, Director 
Computer Science Center 
University of Maryland 
College Park, Maryland 20742 

Dr. Dwight A. Burrill ' 
Individual Learning Center ' 
Miami-I^ad^ Junior College 
11011 S-W. 104th Street 
Miami, Florida 33156 . 



Dr. Stanford C. Ericksen, Director 

Center for Research on Leoi^^ning and Teaching 

University of Michigan "-^-^ 

1315 Hill Street ^ - 

Ann Arbor, Michigan 48104 (313) 764-0505 



INDIANA STATE 



MARYLA^^JD /CHIMP 



MARYi^AND/CS 



MIAMI-DADE 



MICHIGAN/CRLT 



/ 



December 1970 
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Dr. V;illiam R» Uttal, Dir^^L-tui 
CM Project Kon Jc.iVe 7U-7i) 
Mental Heaitli R»'seJrch In.siiLutu 
University vi M|chigan 

Ann Arbor', Michigan 48104 (313) 764-9503 

[*r. John F. VinsonUnler , Director 
lnfoii!MlLon Systems Laboratory 
312 Curputer Center 
Michigan State University 
Last Lansing, Michir,an 48823 



Dr. r.'orman Bell 

Ltarning Systems Institute 

Ericksen Hall 

Michigan State University 

hast Lansing, Michigan 48823 



MICHIGAN AfliRI 



MICHIGAN SIATli/ISL 



MICHIGAN STATE/LSI 



(517)' .353-6418 



33. 



54, 



35* 



Dr. David p, Johnson, Director 

Computer XsJ^-isted Mathematics Program, CAMP 

College I ,ucation 330 Peik Hall 

University of Minnesota 

Minneapolis, Minnesota 55455 

Dr.. Russell Burris^ Executive Officer 
G^nteK for Research in Human Learning 
^ord ilB.1 400 . 

Dniversi^Y of Minnesota * 
Minneapolis Minnesota 55455 

Dr. J. M. Biggs, ^QiTector 
Civil Engineering Systems Laboratory 
Massachusetts Institut^e of Technology 
Cambridge, Massachusetts 02'J39 

'Dr. EdWin F. Taylor 

Education Research Center 

4th Floor Buildii>g-^lpha 

575 Technology Square 
^Massachusetts Institute of technology 

Cambridge, Massachusetts 02139 (617) 

Dr. jTC^R. Xlcklider, Director 

4ec t MAC 
545 Technology Square 
Cambridge, Massachusetts 02139 



Project CLUE 



MlNiN^SOTA/CAMP 



MINNESOTA/CRHL 
MIT/ClVlL 



36. 




MIT/ERC 



MTt/MAC 



imi> 



Decemf^t 1970 
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39. 



^cl.o^l of Mai.ac;tnicnt 



K an 
50 Mer 

Massachusetts Institutt- of 'Fechnology 
Cambridge, Massachu.sct i s OJ139 

Dr. J. B. Adair, Direcio': 
Learning Resour ceb Project 
.Xurtk Carolina .State University 
Rcii>^^h, North Carolina 276G7 



MIT/SLOAN 



NCSU 



40, Dr. Paul Oliver 

Dep^artment of Conipi^ter and InformatiOyH Science 

University of North Carolina 

Chapel Hill, North Carolina. 27514 / 

41. Dr. Alexander Schure, President 
New York Institute of lechnoiogy ^ 
Wheat iey Road 

pld U^stbury 

Long Island, New York 11568 



NORTH CAROLINA 



NYIT 



■ ' 42* .Mr, James Bradner 
Physical Sciences 
Oakland Community College 
27055 Orchard -Lake Road 
Farmington,, Michigan 48024 

43.' Mr. Edward J. Lia^,, Director 

Ocean County Information Network 

* Ocean County College 

Toms Rivfir, "New Jersey 08753 

44'. Dr. G. Ronald Christopher 
CAl Coordinator 
The Ohio State Univercity 
1080 Cannack Road 
Columbus., Ohio 432'^ 

^ 45* *• Dr. James V, Grieson 
College of Medicine 
Ohio St^te University 
Columbus, Ohio 43210 



OAKLAND 



OCC/CAI 



OHIO/CAI . 



OHIO/MED 



Decamber J5'0 



Project CLUE 



ERIC 
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*^ntarxo insiLtule tor ^ludit^-H in hducatio;i 
2:.2 "lour Mreul Wi.i>i 



OlSh 



/ 



Dr. Don.. id D. Fishwr 

Computini; and liir oroal ion Sciences Department 
nkialu'".3 Si.ite University 
St i1 ho. iter, j)kjnnona 7^07^ 



OKLAHOMA 



.1 



AH, 



49. 



50. 



51. 



52. 



53, 



i)r. John H. Newto.n 
Psyciioiogy Department 
University ot Omaha 
Omaha, Nebraska 68132 

Dr- Keith A. Hall, Director 
CAl Laboratory 
20]'-2U2 Chambers Building 
Pennsylvania State University 
University Park, Pennsylvania 



16802 



OMAHA 



FENK STATE 



Dr. Robert Glaser and Dr. Wiliiam Cooley 
Co-Directors, Learning Research and j 
Development Center : ^ ^ 

-University, of Pittsburgh 

Pittsburgh, Pennsylvania 15213 (412)683-8640 X7555 



PiTT/LRDC 



Dr. William P/J^aish 

Planning Office of Urban Affairs 

Archdiocese of Boston 

7 Marshall Street 

Bos tqn, Massachusetts 02108 

Dr* Robert R. Korfhage^ 
Computer Sciences Department 
Mathamatical Sciences Building 
Purdue, University 
Lafayette^ Indiana 47907 



Dr, Robert Ceding 

Rochester Institute of Technology 

NIID i\0.- Box 3415 

Roches tet. New York 14614 



BOSTON/POUA 



PURDUE / 




ROCHESTER 



/ 



Project CLiJE 



December 1970 



ERIC 
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5^. Dr. St*%en r . Lc-'er, Director 
Dt'p sr imei'il Chyriistr ' 
^Lv:v. Fias^r University 
nurnaby 2, uricish C* lumbi^J 

55. Prof^SFor l\xtrick Suppes, Director 
Institute lor Mathematical Siuaies in the 

^oi.i-U Sciences (Math Project) 
VentuiM Hai I 
Statu ^'ra Ui.ivursity 

Stanford, Cai,iiornia 9U05 (415) 321-2300 X31il 

56. l)t t Richard C. Atkinspn, Director 
Institute for Mathei^atical Studies iq. the 

Social ScienctiS (Reading Project) 
Ventura Hall 
Stanlurd Univerj^ity 

Stanford,^ California 94305 > 

57. Dr. Mnrray u. Phillips, cWirman 
Department of Education Communications ' 
Education 115 

State University. of New York at Albany 
Albany, New York 12203 



SIMON FRASER 



/ 



STANFORD/M\Tn 



58. Or, Robert S.-Harnack, Cha^'rman 

Computer-based Resource Unit Project 
School of Education 
220 A Foster Hall 

State University of New York at Buffalo 
Buffalo, Nev/ York 14214 

59* Miss Sylvia Wassertheil, Director 

Computer Assisted Instruction - 209 CSB 
State University a£ New York 
New Paltz, New York 12561 



60. 



STANFORD /READ 



SUNY /ALBANY 



SUNY/ BUFFALO 



SUNY /NEW PALTZ 



SUNY /STONY e?.OOK 



Professor Edward D. Lambe, Director 
Instructional Resources Center 
State University of New York 

Stony Brook, Long Island, New York 11790 (212) 687-6681 « 



December 1970 



Project CLUE 



ERIC 
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Dr. 



ChrvUlan ii.i ersit^* 



Dr. Vii^iur BuiIcIl rs.m. Director 

hut t on t-ai . 

C a I ve r^. i l v of 1 t xas 

Au-tfn. Kxas 7S712 (512) A7i-334^ 



rcu 



bl. Dr. •:arl B, Uunt 

Department of Psv holugy 
University of V/ashin^lun 
Seattle, Washington 981 05 

6^, Dr, Stephen R. Yarnaii, Project Director 
Computer Aided instruction 
Washington/Alaska Regional Medical Prqi'tam 
Universitv of Washington 
500 University District Building 
Seattle, Washington 98105 

65. Dr. Leonard Uhr 

Computer Science Department 
1210 West Davton Street 
University of Wisconsin 

Maddson, Wisconsin -53706 "X 

66, Mr. Robert E. Hove, Director 
/ Instructional Media Laboratory 

/ -University of Wis^^ ^sin — Miiwaukee 
Milwaxikee, Wlscons 53201 

67. Dr. Pihillp Lanbertj Director 
Instructional Research Laboratory 
308 Education Building- 
University of Wisconsin 

Madison, Wisconsin 53706 (6J8) 262-3888 

68, Dr. Warner V. Slacl , 
Assistant Professor of 'tedi^ini.^ 
University hospitals 

1300 University Avenue 

University of Wisconsin , 

Madison, Wisconsin 53706 



WASHINGTON 



W<\SH1NGT0N/RMP 



WISCC.'iSIN/CS 



W15C0NSlK/m 



WINCONSIN/XRL 



WlSCONSIN/MEp 



Project; CLUE 



DecembGx: ■J>970^' 
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11 



I 



5. Inter-University Projects 

1. Mr. Henry Chaunc , President 
KDUCOM 

P.O. Box 364 ^ . 
Princeton, New Jersey 08540 

2. Mr, John C. LeGates, Director 
Educational Information Network . (EIN) 

' EDUCOM 

IQO Charles River Plaza 
Boston, Massachusetts 02114 

3. Dr. Peter tJ. Lykos, Director 
uooperati|Ve Venture in College 

Curriculum Development 
• Informatid^n Science Center 

Illinois Institlite of Technology 
Chicago, Illinois 60616 

4. Dr. Bertram Herzog, Director 
MERIT Computer. Network 

611 Church Street 

Ann Arbor, Michigan 48104 

5. Mr. Louis L. Parker, Jr., Director 

North Carolina Educational Computing Service 
. P.O. Box 12175 

Research Triangle Park, North Carolina 27709 



EDUCOM 



EDUCOM/ EIN 



IIT/CVCCD 



MERIT 



NCECS 
/ 



/ 



NSF Regional Computer Projects 

Dr.. Allan J. Perils 
Computier Science .Department 
Carnegie-Mel' on University 
Pittsburgh! Pennsylvania 15213 

Dr- G.D. McCann, Director 
Williij Booth'" Computing Center 
California Institute of Technology 
Pasadena* California 91109 



Dr. Eric McWixliams^ 

Finger Lakes Regional Computing Organization 
Office of Computer Services 
Cornell University * 
Ith-aca, New York 148S0 



CARNEGIE MELLON 



.CIT/RCP 



CORNELL/FLARCO 



December 1970 



Project ClUE * 
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Prof. Taoma^ L. Kurtz, Director 
Dartmoutn Time Sharing System 
Riev;it Computation Center , 
Dartmouth College ' ^ 

lianoveT, New Hampshiro 03755 

Dr. George I: Simpson, Jr*, Chancellor 

Univer^>ity System of Georgia 

24A Washington Street, S*\:. 

Atlanta, Georgia 30303 ^ ,_1 



DARTMOUTH/RC? 



GEORGIA 



Dr. Peter Lykos, Director.^^ 'j 
Computer Center 

Illinois Institute of Technology 
Chicago, Illinois 60616 - 

Prof* G.P. Heeg, Director 
loxv'a Regional Computer Center 
W i. East Hall 
University » of Iowa 
Iowa City, Iowa 52240 

Dr. Richard S, Lehman, Director 
Middle-Atlantic Educational and 

Research Center ' / 

P. a. BoK 1372. 

Lancaster^ Pennsylvania 17604 

i 

Mr, ^Richard K. Wells, Coordinator ^ 
New England Regional Comp^uting Program 
Massachusetts Institute of Technology 
Cambridge, Massachusetts 02139 

Mr. Louis T. Parker, Jr,, Direc^por 
:^orth Carolina Educational Computing Service 
' P,0. BoK 12175 ^ 
Research Triangle. Park, North Carolina 27709 ' 



IIT/RCP 



lOWA/RCC 



MERC 



■V 



NERComP 



NORTH CAROLll;'A'/-ECS 



7 

11. Dr, Larry C. Iluntfer, Director 
Computer Center ' 
Oregon State University 
Cprvallis, Oregon 97331 

;12. Dr. Robert R- Korfhage ^ 
! ' Department of Computer Sciences 
; . Mathematical Sciences B\>ilding 
' ..'Purdue University » . * / 
Lafayette, Indiana* 47907 

December 1970 



OREQPN/RCP / ' ' 



PURDVE/RCP 



P.rolect CLUE 
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13. I^r. John Hamblen J l^lrLrior 

Computer Facilitie.^ for Instruction in 
' Stnall Colleges 
Southen"i Regional Education Board 
130 Sixth Street, N;K. 
Atlanta, .Georgia -30313 

Ik. Dr. I'aul Armer, Director 

NSF Regional Compuring Project 
Computation Ce^er ^ 
S tanford Univery^^y 
Stanford, CallfornTa .94305 



13, 



16- 



SREB/RCP 



ST^\NFORD/RCP 



17. 



:^lr. Fr^nk \\. lioos^ton 
Department of MathemaTir^- " /' 
St. /\nselm's College / 
Manchester^ New- Hampshira 03102 

Dr. Anthony Ralston, Chairman / 
Department of Computer Science 
Stat^' University of 4%w York at/Buffalo 
4226 Ridge Lea Road ^ 
Amherst, .New ^York 14226 j 

Dr. '^'.arles H. Warlich, Asa^ciate -.Director 
Computation Center \ / 
University of Texas at Austin 
Austin, Texafi- 78/12 



/ ST, ANSELM'S/RCP 



SU^^f /BUFFALO/RCF 



TEXAS/ RCP 



18* Dr. Roger Elliott 

Texas Regional Actideniic Computing Experiment 
Jexas^A"5< M University 
College Station, Tejcas 77843 



TE^S/TRACE 



Project CLUE 



December 1970 
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Mier Res<^arch and D^^clapment 



Dr, Mur/ray Tondow, President • ^ ESC 

EducationateSys terns Corporatian 

Stanford P-O; Box 2995 1 - . ~ ^ 

Stanford, ealifornx^ 94305;: M 

Dr . ' :Eriies t _J ♦ Anas^sio ^ _ . : _ ^ KIS 

Rese^rcli Tsych^ogiist: and Assistant Director 
- - Office of Data Analy^^^^ - - _ - 

-i_ Educational -fes ti^^^ * ' -- - _ •/ ' 

: Tri^iipetonV Ne^^r 5^^ 

3* Dx. Buane Richa/ds " 
- ; Res ^a rcii J^nd, jDe^^^ 

- P.O''^ Box 1113 . ' . , ' ' 

5;§0alo^^to^_^i 




f i :^:KWS£^^iM -:4^% ^^^^^ 

" ggigg^ Main Street " 

zK_?_^nia Mo ni ca js^^^^f o;r nxar 



6. Dr. James W. Becker, Executive Dijr^gtg±g 

Philadelph:^^^^^^^tiy^^ ^g^ ^^v^:sa 



90/4lir 



RBS 



7. Dr*]^iT^^(^^^^^EK^<il^^^pte^^^ 
^g^^^^^^^^^^ational L^^^^^^^ngi^^^S 



6x^^g5^go^^^6^80 631 

8. V nr. ^^^^^^^^^^^ Directoo 

Computer Sciences Project ij^^AsS^sf^ 
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ACTION FROGRMS FOR PROrESSIONAL ^OCIETlES AND OTHER GROUPS 



-Discuss!ions t)f the contribution ^profSsslonal:socle|ies^ and other gruops to 
-ef feetajve-dBWtopnS^^ uses were £requeAt during Project GtUE delib- 

eratioife. ^Excerpits J&m thos^^discussi^ together ia J:his ^ 

' -^anp^Bdix^ for tli^ .inf^orit5^^tidn"5f - i^^^ of ^Appendix A 

^ -gf i/dlume I provides ' a samplii^g p£ pxe^^^^^ activities, and programs within 
- professions^ ^ V 

The id^as and tentative proposals put forth should" be further developed by a 

. ^^panCl^;^wdirf^ .^^^ole of the professional 
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Journal Publication and Keview of Comptiter-based Learning j^aterials 



i 



JPubXlcatdLon and review of , ^computer-based le^^rning materials in journals serves 
many useful purposes. ^ By^br4.nging professional credit to tlie author, 'the 
publication encourages him^o give tlme^ to the writing arid maintaining of* 
institutional^programs. By publishi^gr>i3:ly referred reports of materials avail- 

^able%n impotltafft jchecfe on^^^^^^ is djitrodiiced* ^Finally, 

views' by -qualified persjons potedtiai ;^sA^^ Information on '^w^ich 

^tp;; bas^? seleTatiohl bf^^materials • 



Howe^e^jiS^n^^ ^ s^lidlt-su^^ 



^ Ivas^^lS^n^^ 



^d^j^cii^^^x^siu^ techno- 
S^^^i^ac^^ir^^;^^^^5sS i^aSera^ 



^^v^cSni^l^cc^i^^^ . 

^.^nll^t^^^^^g^^ nether 
^ :jf5qd^jfe5$^fepjl^^ p^obletfs 




l^cii^^S^g^^^^^^^^i^^ failure • 
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Matters to Vhich- reviewers might pay particular attention are:, 1) the extent to 
which the* computer contributes to.. the effectiveness of the learning materials; 
2) the rationale for the ins true td.qnal strategy used, and [the trarislatability 
of t^ exercise to other computer systems. Sampl^., guidelines which elaborate 
on* these ^nd other points should be prepared ."n 



Some journ.als have recognized the need to disseminate information about compu- 
ter-based learning materials, /even to provide a, library of programs In computer-; 
readable form^ e>g^ , the American Journal of Physics » Its policy grew out of a _ 
1965 Conference spons^ ' ' , ^ 



Besides 'its Ubual regufeements f o^^^^ication> the Journal lis ts three /criteria 
_ for^^ccep tance^ oj^^ J^he_^ Jj^X^^ bSen^ tested'qrv"' 1 

aii^nSic^^ cqm-^^^ 
puter in^ta^^^^ mus tj aliow Tun^ 

in^qma 1^^^^ n^cThine^H^ b| tKfgimogr^^^^^ the iournal^ c^an 



Jp^^J^^n^^pjig^^ Six iteife are . 

J.n^ad|dLon\J^^ J>.asic 




s^b3 ej^e^arjV,. leyel^o^^ t^e/^en t^by^ s^^^^ 




^rpgt:Smmi^^^^^ _ jSS g^|^S^|.^^ 

t|iei^fi^si;c and _ the . , 



------ 



Regional or national ^libraries of ^m put er programs and related documents pro- 
.Vide a promlaing ^ay in vhlch to as sist pr ospective tjsers of computer-based 

niaterlals in locating, previewings and selecting those vhlch might be useful for 

- ' - ' « ~ . -- 

needs 




encourage site visits jwhlfh 'facilltrffte collection, confirmation and distribution 



uch a library should not attemptj;^ cpver wmputer-hased Uearning materials 
jfor more , than one lxscipllne~oFl)ro_ fessi on_(such^ chemistry or architecture) 
although a wider grouping (such^^s^^e TiwDcanitles) migit be an appropriate 
jeginning iii areas of few appiir^tTons^ suggested that the 

geographical region served .eacfr^1>^raryl: 



Quid a^jso be restricted to 



of> effective and releV4nt tnaterials. 



Organizations in several subject ^^^^are--arlr.eady experimenting with such 
s^Y^ces. EDUCOM's Education Informalxion Network <EXN) illustrates a general 
typia of InterinstitutiofiTl ac^t-i^^^ assembled a *directory of programs 

opera'tltig on university cgpputlng^ | y3 tern s in a wide region. The important 
cont Jibutiqn EIN wa^_to^ be the f a^llta^on of < access by -Arranging computer 
i^iccess and cohyenlent. billing*. However > EM Jias not given particular attention 
|o^*t% probie^ of J?it ting ins truc^tional packages ^epared.for one environment 
to rano^^ Such a seryice^o uld^^ ^ prepared t/^ assist in 

iq'cuisintat maihtehanceVoT prb^^^ 
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During the middle jf the last decade tlie mo-st visible research and development 



■programs werft directed by educatxdnal teclffiologists, post of whom were uot^ 
also'expert in computer technologj^ and, inforraation systems. Even when the 

.educati<^nal research an^materlals ieveropment were of good quality , the 
computer was not well usld, and computer-assisted instruction (CAI) acquired 
the reputation of an^Mfilmagiijative, c ust l y, page- turning teaching machine. 
1 ha4 tried to assemble a samplihg'of project reports which are suggestive 

. of the contributions to be made by the nsi ghtfu l engineer and teacher to 
research and development crTlnstructional use of computers. 



/ 



Problems with GAI in the.Fir&t Decade ::^ * . , " # 

The dificulties" encountered by educational technologists using computers 
in the last decade cart be characterize by -a brief in^lysls of the pre.sent 
status of progranmiing techniques for specifying Instructional strategy. 
The intriguing idea that the progBetoming of an automated instructional 
-procedure could be immediately aMessi^le to^ciassroom teacher or textbook 
author without tfalning in coiaputernise led to the. preparation ofonumerows 
"author languages" wh^h were to bld|iH'omputer tutoring aids into every * 
classroom. : However the simple languages onl,y encouraged trivial uses, and 
the-programming- for any instruction.ar strategy' othet than the uninteresting 
one the language designer had jrinind. was found to be extremely tedious. 



\ 
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Another kind of service is ptovicfied by libraries and dlstriibuti^r^systeras set 
up by various regional computing services: Triangle Universities Computation 
Center in North Carolina and Cooperative Venture In College Curriculum Develop- 
ment at the IJli^nois Institute of Technology for the Chicago afea are notable 
for their size and history service. Many others (about fifteen are supported 
by^ the JSationill Science^ foundation) have begun program libraries. In fact, ^he 
success^^^ su^ network operations presumes the existence of- libraries rich in 
programsTelevaT^^ to tha current needs of users. 

Yet a tljird kind of iti^reawLnstittitional service is that exemplified by the 
program file being assembled by staff' at the Northwest Regional Educational 
-Laboratory • As pajct^of Project REAbT the staff is soliciting material from^ as 
raany^ sourQ€?s as possible, revie^^ing and preparing abstracts to describe the 
jtha essential feat^ures: of tlie ::ma^ The abstracts 

arejin eluded :in a; cef erence cXtaXqg wHich is upda every few months and 
available on request /v^^^ by, flusters of subjects or 
curxfculum areas, and includes m^^ on student-written programs 

as well ia§^th which us e ' \canne§" ^^p r ograms as an ins t r uctijona 1 device ♦ 

Conferences Involv^n^ Venders » Pablishers, Authors, Users and Sponsors 



t cbmputer^baseU lear^^ be^ yidely lused, Improved methods 

of _ docipenrtaticn necessarry to* transiat;e^prog^ams- frons ^ 

one sy s temv^^^ another* One s tep toward better 

ais t rlbutibn. of ma^^ be conferences , of equipmen t manuf ac turere , 

authprs ,_ jSufclishers , ^and the /administrators and users of computer-based:^_^educa' 
tlonal; systems^ ^ V ~~y r — 

The basis: for dis;cussion at such _a conference should be ^background papers 
prega^red, /in advance to^pToppse standard .pt^sctlces for documentation of le<?4ning 
exercises .and j^^^ encourage making materials pr^ared 

for^Vni^ sys^^e^^ papers might be pre^red by selected 
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acpeircs in the .fie Xd and reviewed by a sample of vendors,, publi 
before the conference.' • ' . 




and users 



X. 



Participants in the conference should ..include representatives of the publishers 
and, equipment manufacturers suCh ts IBM^^RCA, Philc6-Ford, Westinghouse, Univac, 
Honeywell, Computer Curriculum Corporation, Raivdom House,, Harcourt Brace and 
Javanovitch, McGraw-Hill", .and Science Research Associates, probably inviting no 
more -than ten to participate in active discussion. , To' facilitate this discus- 
sion .-the number of administrators and users of computer-.based educational systems 
^ might^ also be limited to about ten selected for their interest in promotlnjg 
'transferability of materials. jThey. should represent different student levels 
and topical areas of education.- 0th4r persons--c^^^ 

: The conference would encourage' Ulcers to statfe their needs clearly, publishers 
to State.'the requtrfiments of production and distributlon.^and vendors to specify 
the economic and; technical restraints on further system development. As a 
irestilt;,: new c¥anneis\ for, coivtlhufifg among organizatipns and among 

individuals would be Sstablished. i | ' 

x^he^e%>n<^Mts^cou'l^^^^ actflpn-qrlented report wtji ch should 

=7iuclude5:a\ ckYelut^^ss^ismen t \pf^ c further 
steps to develop standards, organize centralized . files of information and 
programs, and encaurage publication and review of computer-based learning ' 
materials. • * . - , 



2\ The Role of Sponsoring Agencies 



■I 



-/ -J 



E9tehtlal-sponsor&.«3 



aatlvities sTiould support conference 



and review aciti,vity. as well, as inditidjial projects. Instructional use of . 
computers 'is reaching a stage where -Iblroay be as important, or more so, to 
promote the exciiange of information ablout specific materials and operations 
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than to ^invest in independent^Mevelopment projects. This should in no way 
conflict with the f.ssential support for continuing research, activity* 

Agencies^ might talce a^more active role in discouraging independent work which 
is likely to duplicate work already in progress or completed. In part/ though 
the conference activity proposed in the previous section, in part thrc|ugh some 
kind of clearinghpq^^^.tiCL4)e estaljlished, it should T^e possible t6 be appropri- 



ately selective In fund>^nf o : new projects ♦^rSome agencies, already idjentify 
project ^proposals which are independently, conceived anS would be%xe(|uted at 
the expense uf coordinated work; sojne of ^the clues arerV: failure to reference 
the work or a similar nature by others; failure to plan for the^ effective 
dissemination of findings from a developmental ox exploratory pro jedt; failure 



/- 



to provide for^ the ex:change^i:o;f oa-?going worTc throughout ther project^ 

^ ; ; V ---^ 7 /support: /: - \ - - I . j~ * , 

In light of the^ advice .^to^ confer en c^^^ and zdiscqurage _ indep|n^ent ariS 

duplicating effortsvisppnsoMng age^^ not oyefrlopk .posslbi 

exploij^ing confeerciaL tot^^^^ and_ prpfit^^ computer use 

rinj^eduBatipiT//^^^^ geveflqpment 

centers in the uniyersi^^^ can now- bi a^Vf «eatively accomgri»she|i by ^ opera tionail 

^i>rojec£s within ^^^^^^ Sector. , JS6me l^^ most of 

-- the. sof twar^ tievelppra^^^ therpVfilicatlons^^^ and fother service ^ 

fimctidnsr c^n be" handled- well Jby the ^prgfit! inMiltlVeT^ Univer^^ 

3 groups and ncffl^p^^ groimd, explore far- 

- _ reaching iTnpXi ccmp-ut^^itecH^^^^ arid evaluative 

r .studies, and <itheigwlse.lieij^ .not 

be nec^^saxy to ls:ubsidi2^^^^^ of compu^ter-t^'ased 1^ 

matferirais,^^^^^ (sSxcept at some^ 

iMnc e -^the^p r i? 



miriimafcley^^ s^vice is yiable and 

.prifitsYari^^ possi^^^^ su^ort t^he continuing 



,reyiw ^ctivitie^ the _field. This |eads to the last /< 

^-^^oinV;^^ndfo^^^^^^ 



/ I 
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- A blue ribbon panel on con\pjLiter uses in eaucatlon should be established* One 
or more professional soci^t^ies might be involved; mote likely it would be 
associated with the National institute* of Education or National>cademy of 

* Sciences. The functipiy^of one^ox more such panels would be to keep a^watchful 
eye OQ the development of the field,, the role of commerciaijinterests» the 
extent^to which institatiotjal needs are bei^g-met, the distribution of research 
and development monies from federal and foundation sources, etc. Representation 
on such a panel should .include the imiverslty <jR&D centers, diversity and college 
administrations, A^piinlstrators in the public and non-public pre-college ^schools 
and individuals from non-ptof it and profit-making organizations likely 'to make 
a personal contribution; to^deliberations of the panel, \ 

' \ In ♦ each,, of the above cons id'exations ' the sponsoring agency^should recognize 
dii^tit^ctloni amo^ lS.nds of effort regarding compuder use. in educa- 

tion. Different sets of useU; the.lmportant point is not to 

copfase^actiylty.inten^^ to" develop jae^w knowledge with that intended to bring 
' services- 1^ Colleges. 
l^actlyi£y should :nol:^^e„:^*llght b^ing placed on 

_ iacreasingVoperatipns ♦ ^ f urt1}e^pte,\^^^ s tudies 

, shpul(l iv4t ,be expect large>niun^efs\^^ r^rinally^ the 

.6perat^ to^ ^exmanent sources of funding to 

.^rp^rid^S ^v/ \ . 

l^early ey^X*^ the area of 

^comp^^^^ reylew^^^ df what has been 

done and ;what e^ dozen coua- 

Ittl es; xe^^ ttentloH*^ J^^ quxrent .an4 cqmpreliensl^e library 

"bfeXnti*^ if ax /teyond^t^^^^^^ of. individual proj ects for 

i(^l^cti<n]^?t^ " ^ 
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Functions of effective Informatioh^ exchange should be assumed by International 
organizations ^uch as OECD, UNESCO cahd perhaps IFp. Only these kinds of 
organizations can assemble the necessary talent for -selection and interpre*ta- 
tion of the yaltJabfe w)rk. Increasing numbers of technical ^eportg^ tljeoretical 
papers, research notes and opinion statements are being placefin |limited 
Circulation yacfir month^i ^ . ^ ' - \ 



Some informatf on functions crossing jiatlonal jbbundaries shall be handled well 



by pt^lishers of internationaJ.--^tature bjut th^y should Jy^^rovided sound 
direction by^ some group. of professionals; eventually most information exchange 
functions can beippliced on a payl.h^ basis, but initially som^ sufisiay is 
necessary • IhdtAd.duai governments andvintejmationa^^ sourcesVof^ funds should 
support Ifeilpw^ J'lndi^daal 
pro j^clrs w^H :pay^ :|gT _ex&ange pi df^^cm^n^ation^^^ of partic'qlar 

advfn^agett^^^^ ^^^oa^f; df- be^ stippprted by_- ^ 

^siibsc^Lp^ici^ o ^ 



Along wifli;^^^^^ for exchagge, of information 

^abo^t pfoJi]c t^ ^interes te^Vinr^ Sudi 
jLnf Q :a^\S^iiy^rp indiyidt/als about 

\^|>I>^gm:i^t^ site, "or 



oDial^^si^^Sj^^ at a. conference . 



Me gene^^ :mee]y.ii|;fe by OECD (March) and 

ip}P>;J^^u^E^4^b^ 

a^g^p^t^^ ex^n^ ; IfecKaniinfi for ^ information 

e>^t^t|ge ;a^^ brief Indignation of 

tfie^g^^^^ni 

Elabq^a^t^pp should be ^& first 

ordei^ of busi^^ th^*iivext jne^^ of an international^ planning group 
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asLsembled to organize mutually beneficial activities regarding, instructional 
-use of computers; the U.S* Government and individual projects should give 
full cooperation, ^ . -r-^- 



a. _ Library of research documents, Project- descriptions, instructional 
*^ material dfescrlTptions, etc,T» al^ available in French and English 
^at least. ^ \ > ; / _ 

Two cptiona are to begin with: r ; ^ : : 

1. Education Ifesource^^d fiifor^ 
especiaily the Ciea^Lhgho 

Univexsity, collato center pro-' 

^ding- ±i^aii§Jai^ ^ 



7-r-. 



siz^a^l^jjMfcr^^ 

^^in^p.^^^^J^v^^^^ ^ 

b . 1 B^ulletto ^ o^^ in^e^ucajtiqn^^^^ p^jhlished on a: regular schedule ^ 

^m<i^^^ 7:' W;^^^ " 

\\ V: (usA> . 

K ^rWi^/^y^^^^^ is^jK@pnal^^ ^ (UK) . 

^ . :^^7 J "3^ Ns'es in 

^ Education (USA), ' { /V I " ' . _ V 



erjation wi th_ an. 



^ r^^^^rS^^;: and 2 

sponsoring the 



_ -^^^^Si^^v ^ M^^Gpin^S^ui^^ on th^ merit; of 



m 
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d* Current awareness service> distributing selectively to__projects tend 
7^ r individuals according to interest prof iles provided by them as users 
.the sep^ice* " _ ;^ - . . 



Three ^)actors will affect the success J 
iv. Prepar^ion and effective use of an expandable set of descriptors < 
2. Prompt and. rellal)le classificati6n of documents. 



---- z-^---M 



|-_-f>^_-^_-. 




I. 



e< 




3. Reliable* data on use and satisfaction with which to assess the 

•Improvement of the: sy^ \ - } . /: \ 

lOther arJatigem^ materials (iid^per- 

haps ; per49nr|^^^^^^^ projects or indi^duals . , 

A central organization -can f acii±tat% intercha^^^ providing: 

1 tDiSecto^^f^^pirc^^^ gi^ng_rint^^res t * profiles and 

-v^^nmilingfSddi^ ^ _ 

2v iAssls t^^^ for 

3 . : _^5j)uta|& to - 



Lst^ahcer ofc^pj^^ > ^specially 

:in5ass(y3s^oi^^ ^ / " 



fl. :J^h%t^y 

v:'^^^^^^^?^^ rdf/^pl aces^to 

: r; toX^co^^^^ 7: ^ ^_ ; i 4^ 

f 2:V ^ A sge^^lgS^ ^M,aces^Soiy£^^ site 

3 r 7^^^^€^:§r(B>d^^ ,^i te _>^si bs 

- : ' '|i-a^^£oa^[e^^ interested ^ 

F_ v^^^ new ^cl:£vities 



/ 
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- ' -I ; VOLUME: ir - AEPENDIX B , ! / 

PR0J£CT NOTES ON .COMPUTER SYSTEl^ JDESIGN POR INSTRUCTlON^vL USES 



Many working papers 6n computer languages gid systems wei:e prepared during 
the project,, most of them. f5r presentation^M<3^^4^^^ conferencejB 
and symposia ♦ Tl^se^^^ariey^d-sto hav^ soi^ ^ intetcs t for spe cialis t'readers^ 
are described: ia tM^^'Sppe^^^^^ of contents. 

When the source, of the/ifuli copyz^^i^^^ is not convenient, 

address Inquiries tb^ the 



JlMS'^lp^dix J^s^^includ^^ ^ 

tedinical aspects^which^,M ptoject. It -should tiot 

be tised as a tutorial oil ccrtcpt^^^^^ a complete study 

of computv^r science c6Etribu^ons•^^/^^:^v ~^^^ - \ 



______ _v --- - - -I- 

if^ l^laijni^a^^^ System:;, 



^. - iip^^slnst^ Zina 



7"* 



4 — ^1 



/3Svs ti^ic tionatea^ 



6. Requirements for Pr&granBdng Languages in Coiaputet-Based 

S^H^ " .^^Ziiin 
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technical Gonsiderations la the Design of ^a CAI Computer ^tem 
E.K. Adams.;, . - / / _ ^ 

Prepared fox .NGET Seminar on Computers liv Education^ I^eds, £npand, 
Sept(^er B-^, and for P ^ 

. . : ABSTRAQT -^^"--^ . ' 

An enum'eration 'o£ techhicaT considerations Aat^^bvern the ifesipi and 
specif icatioh of a^ CAI system.^ The d|%cussio^ is in three parts: "firs tr, 
conatraints MtKat are external to the /jeduca^^^ * 
^ - - — ' ^ • " *- -^"^-^-ta, and, thirdo some of the major 
features of ^^education systems at tTi#-px^ 



P /_ _ - - - _ _ :^ _ > : . cqOTEOT^^^ 

GENERAL INTRODUCTION: CONSO^RAINTS 

: trends - ; 
}: ^^^ierpiSal^ ^^^^^ y 

^ -- - Jrem^^ V 
7 vi^Jspecial^^ ^.^]jf:'i^~ 1^ 

~~~~~ ^iy^em^^v^^L^yc 



tpxograms^ 
^coiirSesS^ 




content ^ ^ • /, jf - ^^^^ 
fm^^iafi^n^^^ 

"^xToatfof'aS^e r 



;Rici 



^sca 

ilvaluitibnV V ^i^i:?^ i 
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Author languages \ 7 ^ 

fijnctlonal ^capabilities 

Program preparation 

- content independent of code \ 
control localized and \free of content 
a:nswer pTocesslng separate from ^coxing 

^ cfentrbi separate from learning t progr^ 

/ difief^enti^^qn of roles 

> Operational aides for" ^ - 

/ proctors; ' ^ ^ - ^ . 

/ - ^jperators^:^^^ ; : ^ - ;^ : 

supewising teachers _ 
sttideiats ^ : ^ 
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published in iBxoceedd ngs^of a; on Goroputer -Based Learning Systems in 

. M_o_cgtiQn:ff John: Ann^^^^ for 

. OMucd^tion^l^^ Schools ,rlitd. ^ tfirough 

JCpuncils^ and^^^^^^^^ lO^Queen Anne VStreet^Ix)ndo^^ 9Jfl), England, 



^ / 
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II App System Design "^^ * 

Some.PTOcedurar'^knguage Elements-'^^^^ in ' an Ins tructional Environment . 
Gordon ly on and Karl L'. ?inn . . .. - ; 

• ■ "■ INTRODUCTION , ' . 

rne instructional' eh\d.roninent demands of a=^prSgramihin8 language -features ^ 
not easily satisfied by- an> one impleffien tat ion, - Some .users will program' * 
instructional modules cefe^ s|stem;' these require efficient and _ 

probabaxlEeetftraht^achlne^ c^^^^^^ ^« 
-^S^^^Ify a"^ro^:£tt^or wg^-^^^ 

. iri tthis case an, Interpreter prol>;^l? serves be tte^^ cbmpiler . Further- 



:i^i^;^^e:|iieiSutiv^ 

Eile^. Such^?a yarlety^ of^ forces-' a 

)Otfie;tical 

progtaniming language, comparing' existing langua/es against the paradigm. ' 



,such a.s ; general^classesiga: 
general discussion into a framework- of general fe^res for a 



Of six .languages considered "in this paper,, some are cQmpiler-iii5>lemented ,. a 

;j,fewi^S^|peafS ^ 
powerful enough for syst.emsr.modules. one is an extention of a' common ^ 

is^^HS&^SlMa^l^l?^ jCpi^bab^y last) ^ 
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■ Statements and Module^ * , • 

- " I - ' ' ' « 

^ Procedures ^ . ^ 

' ' Taaks , Parallelisms - - . 

^ Interrupts " " ' 

Other Points ; / . 

Siamnary . X ■ ^ ^ 

THE LANGUAGES XBL/I>.'AEL,_ CATO, BAS^G', STRGrCOMP) ' ' ^ 

APPENDIX A: Some Requirements in-Instructional Languages 

APPENDIXES: Elements from a Hypothe ti^cal Xnstrucl:lQnal Language 

APPENDIX C:; An Example of the: .Use of Macros / 
^REJERIMGES >: ] : v . _ \ / > " / 

' S^ublf shed^^H^^^ Proceed^^2££^S^^ 

^fe j^a^on ^^Jotiiv^^ ,Na^i5nal ^Qiancil^ ^ 

^Anne/Streiet 

wM;9LD, England, ; - . * ; . \ ^ - ' _ 
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A Man-Machine I^srspectiye on Instructional Use . of Computers 
^arl L» Zinn »•,.'.-, 



. , \ ^EXCERPTS 

Four articiesyftave been brougKt together fp^r this Transactions in an 
attempt to interest members of the;Man--llachW Sy^^ and other readers 

in making some contiibution to the _effe^Hve use o-f computers in thfe instruc- 
tional process • ^rom a number pf^pj^sslbiliti^^^ four which 
together suggest the variety and the depth of man-taachijie>ystem contributions 
to computer uses In educatriQiu^Jlt is cleait to ine. th at-' engineers^pho^^d- be 
interested in the probiems-of eS^ and rele^. . 
vance;:Vperhaps these four, r^^^^^ demdnstrating th^t they 



--\" 



couia^ ake^a- usef^^ x-related Ins tmctional sys tetos 

and ^le a'mlrig enyiirpjuien ts^^^ 



\ 



-A- 



i hsn^ appllcatiidns pff 

^:omput:^^ ^ srtuiv ^ ten^Jjaris^^r^^f to^^ ^ Another i^er-- 

spectlve on computer contributions tp leaTOln^ an<! performance Is provided by 



th2 iot^Q^^ Hip^t^pr 



Humanizing Machines" printed in ttife. February ^3 vlgi^e issues of Interface 



the Bulletin of^the ACM Special Jtit^'rest Group^ oh Computer Uses in. Education. 



i \ 



_ ,Ten years ago the initial projects on cbmputet-based instruction depended^ ^ 

upon creative effort of- computer scientists, engineers, psychologists and 
humanists;- many of the early develo|ments were sugg,e3tiw. of significant 

Vcp^piAe^^P intetestij 
learniilg exercises appeitred to result from Insight into the processes of 
learning and problem solving combined vdth' mders tending ^f the possibilities 
arid iimitations' of automated information- processing/ ; Critics^ of , computer- 
assisted instruction today point out that the. actual benefits have fallen 
far- short of ^what potejTttial./^er|A were led'ta expect* , , ; ' 
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' approximations and other extensions and additions to the instructional 
programming languages have not eliminated ' the difficulties* ■'^ 



Tae computer has been singled out among education media for its infinite 
capability to branch, depending on the response arid individual ^characteristic,^ 
c' -^ach student. However, selection among a few Altematiy^ frames of . I, 



information and questions prepared in detail in advance "^oes not ;^ave^]suf|i--'' 

cient adaptability or economy to justify ^ e computer role in control 5f 
' " ^ I 

audio-^visual media and stimulus sequences, except perhaps ii( situatioris where 

students with high need will not otherwise receive attention, those culturally 

distant from theix teachers, and specials education students in systems where 

individual attention is- not provided, ^ 

^_ - / \ 

Language designers responded to the expressed need for facilities to better 

individualize dAI by adding to existing languages' stateiqents ^Klch access 

: ^ ^ . ^ ^ 

^and manipulatevaddltional data such as/ error rate, response latency, previous 

performance and attitude Sle^^ures, but^ most of the effort was misplaced and 

the situation is not much improved for operational instruction aids in the 

schools » The task of the author planning substantial curriculum development 

. * . : ^ ' - . ' ■ ........ - . / 

still is unreasonable within the constraints of the ins true tioh-^aodels 

^ .implici in CAI languages, v * 
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-A-£m^of the projects based more in compdter science rather than in 
educational psychology Indicate the prospects for new techniques of 
programming ptocedures and describing data bases of curricula which are more ^ 
powerful in^the sense accomplishing more stJudent hours of effectiw 
instruction foix the same author investment. v ' 

- . .->' .. • ; • - ■. 

-^Research which is rather elaborate and ustially quite costly is in progress 

- ' ' „^ ^^'^ 

for w^ich the general goal may be characterized as **humani:iing the machine" 
by making the conversation the learner has with the computer program more 
likfe one he might have with a human tutor. Initial results o| these experi- 
mentsfare encouraglng^feut not adequate . to consider having practical operations 

_ ----- _ - _ - 

-- ' - - " 

in the schools within the next tensor twenty years. Linguistic processing — 

of iKicons trained English is costly and produces only ^approximate results. 

,j _ - - ' 

Adding Knowledge to the Automated Tutor 

The papers ill this collection include two viewpoints on the preparation and 
use of a structured data. base witl:i generalized prcedures for generation of 
instruction ^uid testing material or for responding to learner-formulated \^ 
questions . Generative procedures have attracted the attention of educational 
technologist because of the fresh promise of automatic cons true t^lon of 
instructional ^programs tuned to the cur*rent needs of each individual learner. 
^Generation is eiasy and encouraging for highly^-struetured stibject matter, but 
. the dynamic adjtistmen^ or "tuning" require comprehensive and inter-dependent 
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Tlie papers of Wexler 



information structure's, and some insight aboutr.^nman learning and cognition, 
at least as observed 



within the paxticular area and topics of instruction* 



I 

and Carbonell pre/ent in some detail dvro approaches to 



putting some '^knowlidge'* and ''intelligence'* into an automated tutor, and yet 
leaving important options about ^se of the information prc^oessing resources 



in tH% hands of. the student. yCar^ell includes his interpretation of other 
work in they^eld, and the^neral|uibntribution of artifikal intelligence^ 
research to computer assistance foi: .instijuciion^ 



/ 



the two claim to have 
Both are information 
nee and related 



./ 



Both-^aufhorj have -a^eently completed sxA^t&ntial dissertations and the 
reports included here speak for themselvea* . Neither of 

/-.- -- / : I - - 

a tool near ;ceady to put into opeTation dn .the -schools , 

s_cientistsf|who aire as interested ifi artificial in tellige 

resear,cK tbpics as in educational technique jand practice. Jowever, Carbonell 

poi^rfts ou/ that he uses hunfein tutorKng practice as a^giiide more than a goal^ ^ 

^nd at times he'^has been willinl to V-'^ld artificials^ 

intell^ence .research/ers f ox the practicality of student-machine communication. 

I believe.^ that the iiajor ohstructions to transitionrfrom research to ^ 

application in some way .relate to attempts to malce the computer respojid^as a 



human would ,to".whatever a learner may wish td 



say* 
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Perhaps an adjustment of goals for information-file-oriented and generative 
efforts and a reappli cation ot techniques will sooner achieve some impressive 
and potentially economic benefits for learning* X would like to see greater 
attention given to! effective interaction between man and machine during the 
learning process: 1 What should be done by each person involved, and what, 
should be done by jthe machine? I visualize a dynamic information system 
which serves as an; interface for a scholar and learner; could they share a 
cojiputer-based, prifmary-source "textbook" which is being updated continually 
by W scholar and lannotated occasionally by each student who uses it? 

' . , . i: • . ■ . ■ 

Serious students anU conscientious tmtversity professors sometimes work 
together £n an eff^dtive way when- a book is being prepared;' this opportunity 
could be extended toj any student and instructor willing to invest some 
minimal- effort to uslan innovative system. The institution of the coiljfege 
lecture has .been described^as "<#ie least efficient means for getting partial 
information from^^the notes! of the professor to , the not^s of thte student.- 
1;ith9Ut kt55 pa^sin& through the lie^^ <^f^either." The hew style for 
educational\dnstitutions and^student^^^^^ th^st a 

cqrumpn workiWenvlronment inil^^ professor in addition 

to yarious tor^ry sources of information vould be quite welcome* 

In a similarAway-a^automated-iivformati^ system could help a learner and 
. teacher share- a commph forking enviironmeht for hypo thes|.s testing, sometimes 

artificial as in. computer simulation of physical jand social processes (e.g., 
ra model of evoliition),:a^^^^^ actual data from 

experiments (e.^. , Selection -returns or radiation measures) . 

Automating Tools, for /the Human Leame r : ^ ^ 

Some have suggested that the best way to Improve the contribution of computers 
to litstructioh accessibility of information 

prpcessing tdols fd;BwieaCTer^ and. other users. A large number of projects ^ 
most of them not considered to_ be CAI, have shown viable alternatives to 
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strictly specified instructional strategies for computer use in the schools 
today. I have included in this issue n^ports on two related 'projects which 
together point out one of tha major pedagogiSli^problems faced by those 
introducinjg information processing tools for student t^ce: monitoring student 
use of, the tools and determining when it is important to intervene to gtiide 



their use for more effective learning and later performance. 



r 



Feurzeig and others report on an effort to prepare a generalized technique 
for processing a student's pr<igrams and monitoring his progress toward 
solution of a problem set for him. At. this stage of development the, lesson ^ 
designer is required to provide considerable detail about each individual \ 
problem. Hore generality can be achieved but at the expense^ of automated 
guidance in problem soiutioh. In any case, the designer of a learning 
exercise using lEhis approach tries to exploit current system capabilities for 
convenient use by students and teachers without' extensive training in computer 
programming. 

Rosenberg and others ^report .development of a system with a particular task 
orientation. The aids fo model construction^^ provided by systems such as 
Rosenberg^ s^ENPORT may facilltatre lea^ of any .agfe^ Presumably 

the nbtation, data structures and communication devices are selected to serve 
well; the pai^ticular subjectmattei^ a^^ level. A language (or subsystem) 

such as ENPORT aid its as^sociat^sd" material sho^ be responsive to learner 
initiative and encourage explor a t^^^ ♦ 



Simulation, gaming, infom and other tools 

facilitate tlie establd:shment 6f en^ of 
concepts ^^d pxocedutes andjshould foster a general strategy of intellectual 
inquiry;*- To begin wi^^^ models and then inx^reaje leamar-desi'gner 

initiative may be^^an important factor in the success for this mode of computer 
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Roie^ for Man and Machine * y 

At an education session of the 1975 Spring Joint Computer GoYiference, 
Thompson. spoke with some enthusiasm for promot^ing inquiry and student discovery 
in the instructional use of compikters. He pointed out that in tutorial CAI 
most of the preparation time is invested in guessing what errors, the students 
are likely to make and preparing diagnostic materials. Thereby, raaterjjals 
which take over two thitds of the author's^ time to prepare may be seen by less 
than one third of the leamfers, and then only af ter they have, been led' to 
making errors. * s ^ - t 

On the other hand, when using the computer for the fjtcilitation of discovery, 
full attention is given to the positive development of course ma teria^> The 
conceptual systems that jre characteristic of discovery aids can be prepfted 
in a rich and enticing form that: facilitates the 1 of the 

student and xein forces ^that experien^^^ a multitude of .pathways 

for selfr-guided exploration aua^d^^^^ " - 

Thfegenerative xsystems !ot^^^ used in a 

^^ues ticrti-answering^^.^^^^ expansive ^^^^i^dxA^zo.^ information b^e, 

J provideMhe^^ today Given two 

^ and: three^-rdimens^^ structures arranged for 

diredt ?^e\d.rig ^^b^^ 

' pepplerxegarding Ci^p^^ i^redict an important 

s tagei^bf explorat^^^^ education • 

The ^Bdel-VMHf^ of "SosenVerg and Feurzeig, 

]espec±S3^;^erKJthe^ given him \fox 

use^;=wl&:>few;c i^T^^ate step 

:^^toward/effective c5^ - 
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In all, my disappointment with instructional use of computer^ to d£.te appears 
to be attributable to a failure of most developers" of CAI sys^tems and learning 
materials to assign to the machine those things It does be^t for each hiiman , - 
learner at each moment, and reserve for the human the things he does better 
for himself, ♦ • - . - ' 



Full copy of tMs editorial and four papers were publisfhed in: 
IEEE Tans actions on Man-Machine Systems^ December 1970* 
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In^lications of on-line systems for- an introduction to j computer applications 
and programming l i ' » ^ 

Karl Zinn^ 

Notes assemWed for a seminar on computer sciences in secondary education. 
Center for Educational Research and Innoyation, QECD 
Paris, March 9-14, 1970 . 

CONTENTS 



OUTLINE OF CONSIDERATIONS FOR INNOVATIVE DEVELOPMENTS 

' - ^ 

General Considerations — , 

Interactive Mode jConsiderations , , 

Categories of Specific Need " - " 

BACKGROUND STATE ON LANGUAGES FOR PROGRAMbaNp IN INTERACTIVE "MODE 

:-;Ddtsiia63^^ . 
^ " E3cJ:e^^ _ 

, ; /A :^^t; b f ^Lar^iagefe^ ' Inf ormation 

r - OUTLINE OF CONSIDERATIONS FOR INNOVATIVE DEVELOPMENTS 
Dl^ General <c^n3W ; > X\ ' 



^V^l^xibxilt^ieyg>^^ a .general-purpc^e 

encpfporaterii^ - 




_B.- :Language^de^^^^^ uses^have different 

^v7^.gi^o6fessd^ inpdel,*^.? 
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C, In an Durational setting, a subsysttiH, language /subset or applications 

* \ \ " - t 

package may be tuned to the needs of specific users; iStudent, 

instructor,\and less^-n designer eack require a different kind of 

support from\he system and a differeat style oi training. \ 

Interactive mode condideratiotis, especially f(^r tke infrequent user: 



r 

A. 



An immediate add respionsive .reply from the system will encourage 



efficient and effective use* 



-4- 



-1 



/b. Rules and conventions should b.e easy to lekm fand later recall when 
/ worlcing' at the rap conyer^atipnai^^^^^ 

C» A cpmfo rtable J di alogue* la poss ible In 



dtrkv" %he system 



nelt3ieS^3b&^ 

^^voui^bfe^ for iiliaself^ things he 

does bej^^th^^it^^ ;:the:mcaiine jserves. the iJtser in 

Its areia of ^trei 



.Drv^exibpi^&^ to 
o^^: teg^bufe^^ea^^ versions ^f a sdb routine ,^^er 

: procedu^es[::;& tfie most' ecoridndcal as well 



yLi*D^_sGa[te^i^ ^f^s^^dtfi^^ 



1 



J>_^rFi-lesr^ an^-]pr£vate;^^eqi^ and 

Igpil^t^J^^ 
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E. ^Data representations: arithmetic, logical,, striiig, pointer. 



and" procedure. 



/ 



F. Definition and' us^^^af^-spe^aTTrou tines, or extensions; single- 
or multiple-line definitions; parameters; mac^ro or subroutine; 
liiilcage to other processotsj subroutine call br operator orjiew. 



statement t^pe, 



/ / 



G. Interruptg^^^r-^tom^tyZLc/ and controllfdf^otection from iinknown 



^uage^ea tufes; ^^ap seA-'tAi^^^ : other set condition. 



H. Access .and** contrqij^^ self --modification 

bfrp^o^gram statett^^ execution of any string ais a program statement;^ 
exainilatiqn-^f^^ of exe^cution; step control 

kid tracitig ofyexe^^^ - 



^1 



- FullOcopj^^^ ----- V 0 : ^ 

SCerit^^5tw^^^Mut^ OECD 
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Progranujiing languages and Operating Systems for Specific Instructional 
Environments 

Karl L. ' Zinn, James W. Conklin ' 



19 





SUMMARY ^5 . ^ 

Desix^ble characteristics ^of environments for self-instruction and student 
research are listed with particular attention to the potential contributions 
of computers and procedure vtLtingto each discipline. Experience with ^ 
computer use by teachers and students in various Academic areas at the 
University of Micliigan is described briefly to exemplify the general specifi- 
cations* A set^ of features" is proposed for a programming language and 
operating system from which can readily be derived a , convenient programming 
facility : adap ted to: each- discipline;* and ,proT)lem» ^Practical use Within a 
pedalgogicai context to prcMidte leainii^g^ahd=^s€Ho^^^^ by students is a 

primal^ consideratipn tjrTOUgK - - * * ; ' J 




Desirab^le' feattires of^ interactive problem solving environments . 
Part bf . th^- success" of interactive prog!ram^ JOSS and 

BASIC can be ex^^^ by ^heTjeas^e wit^^ thesJB^ languages are learned 

and _ ini ti ally tis e d • :Mu& j/o f tt^^^^ advmxtage could; be achieve^f wi th a s imilar 
ji^nvenience availab^^^^^^^ pf suitable {• 

rr^spbnse tim^ for_ thev ieam^ / 

The .esisentiaii^contribution^ p interactive mn^e oi ^nrk mus t involve 

rejsponstvenei^s^^^^^ to^ tbe efforts of the user? 

-and pxQ3diLtpns^^r th#%ser to the system 



effprtf Resppnsiyene^s^^ of: a::processor JiirinS greparatioiv7^d"^xecu^ 
a :PJpgranris-rB\key f or the casu^ the special 

bjaneflts^^^^^^ exanple , the 

occ^ftpAal^ user i^^^ well adSriLi.ed:^^^ (aiiAe^ressioTij an untested 

sSbprpcedure, ox a new outpuife fprmatl> even thoui^^ foiinulatjed, 



\ - 
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and let die computer show him how much can processed- and what the results 
jnight be. Furthermore the processor can "guess" at what the ijser intended, 
begin executing the Instructions, and accept .an interruption and clarification 
as soon as the user recognizes that the procedure should be changed. 

^ ^ \ " . - - ^ 

On-line conversational use of computers' is almost c(frtaiit\to be more costly 
than less gleamorous means of 'access to information processxng aids, but the 
cost is justified if the infreqxient computer tiser is able' to c^«y on an 
effective dialogue widi the system. His^ attrtude toward co^puteMv and their 
uses in his-discipline may -^t times be as iiiportant as his» particular 
accomplishments wtth the specific content skills to be learned* 




Adding limited computational capability^ an existing ioursewri ting 
language cannot be as helpfiil as ad^^^ writing" aids laay 

be necessary for ef fective computer use :to an existing computational language 
A broad proceiduri base promotes tA^ capabilities of 

the corf^uter Cxather than the _ courseisJriter designer's conception of what an 
automated tuffiri^ ought to be), die^^^ the discipline, 

and the student access /to the program^im the leanxing exercise. 

In most instructional teWher or the lesion, deslpier would like 

facility for ppening^^ a^^ Irariou^ levels of use, ,^'d perhaps 

to speciJ^^ eacih ^yel/r Fp learning from 

_ a cpD^ut:er^bas.e^^^ g^e_ote_§ttuabi6ni^caiii when_ setting 

jugf a:^new^^ author can^ibecom^ 

//exploring m^^ Even .the- applications 




':pf ogratmner ^^^^ from th,e level ot.^ 



progran^lng^ii^ features. 



3S^:^yj%tew^ on the basis of 

dis cusslon? wi SJpser statement types 

ser^fe^^ The. stjbject eacpert: should 



s 
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find this seeoxx.d-level notation convenient for building models and for 

I / ' - 

emhe'dding them in a suitable learning situation* The student user of this 
system works at a third level, interacting with the loodel at fir3t;onl:? through 
the abstract simulation as a management game to be-played. If the lesson 
designer provides the student with a means to "urilock" the features o'f the 
processor by which the model may be mani"^ttlate(f in siii5>le ways, the student-^ 
may explore its paraiiaetejrs^and-ljeriiaps- arithmetic expressions and logical 
conditions. The ^ student then is permitted to move down \to ttfe second l^yel, 
to desi^ entire models. or simulated situations. Whenever Jthe task-orfented 
features of the language ,are not adequate to the model building and^ testing, 

the experieitced programmer ls_ again called in to extend th^^se*^ capal^ilities to . 

- * - - f _- _ . . / 

mee.t the needs of the rdiscfipllne'-orlented^usexs* " . f / 

This :^conceptlbn can be represented- In pari by an arrangei^nt df successive 
sheila with permeable boundaries* . The system configuration lies at the -center , 
of the sphere, and the system ^rograimners bviCld up- a shelX arowfd it jto me^e 
usefijLL;f motional capabilities ac^sr^^''^ '"o^:appry.catians- progranB^ They - 
/in turn i>^toluce 3^a"rp^ -v procedures wMclj provide convenience* 

and jpower forfthe^discl^llne^^^^^ who may_ then adap^ these t^k-^ :, 

piken^ed^ procedures fiy students in suitable- pedagogical^ 

conteht^v Ih iit^ 
this papSsTV V_l use| disMpline-rela^^ and applirattons 

prbgV^Bn^d of the processo^^ an$ sys tem^f eatui^s • 



0 jS-I;^ 



^^Becau|e of J:n#\yarletyr^f li:is tructlQnfi^ strategies , _ Intended J^eaming oxitcomtB 

and: writixi^-h^^^ the desired aspects of 

_ /^tiiia jfflui^^ J^qre appropi^ately one works 

wi^ix^^ arid the" means^ JEor 

li^feta of a p?oce^sor oi? package 

--- Full copy published Proeeedings of 'the Ej.rst International Conferee 

^^ppJ^MafiSM^^ Teddingtpn, 

^-inglinli^ : : 
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Requirements for Progtannning Languages in Computer-Based instructional Systems 
KarX L* Zinn , * 



Prepared^for a meeting on computers^ in higher education. 
Center for Research and Ina^tKuctionalTrmovat OECD 
Paris, March ,^9-21^ 



INTRODUCTION 



CONTENTS 



Purposes ^ ' *\ 

Audience . 

Sources of other inter|!tretation"'Sia^^inion , 

KINDS OF INSTRUCTIONAL PROGRAMMING""- ^ ^ 

Organizing the content and' pl^p^ing the procedures * ^ 

Description of successive frames or items * 

Provision for conversation wjLthin a limited context 

Description of *a standard procedure liy vhich material is presented 

Specif:? cation of an environment fbr programming and problem solving 

Relative use of the four kinda^ojL prograismtiig • 

RECOMMENDATIONS • J / 

Maintain flexibility ^"^Z" IT — - - 

— -Adapt-^^to-specific-^uses and us^r-s— ^ -^^^-i^^ — ^ — . 

Exploit interactive mode .o£ computer use 

Relate 1 anguage ^ maintenance and :syst tem^operation to project goals, 

STATEMENTS OF POSITION OR POINT OF^IEW 

Consents of this section In det ail " . o 

Assessment of a language jand systeS^^~ 

General implications of- a language for">trategy of instniption 
General consideration of juriiversaXity \ . 

System lltaitations on laiiguage'_f ^ . \ 

Design considerations / - ' - 

Interactive mode contributions -5oT.eamer and author 

REFERENCES \iVm MNOIATIONS '\' . ; t_ 

GLOSSARY FOR COMPUTER USES IN ^UmiON ^ - . • t-. 
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REFERENCES WITH ANNOTATIONS 



kdasns, E.N., '^Reflections on the Design of a GAI Operating System," 

AFIPS Conference Proceedings, Vol; 30, 1967 Spring Joint Computer Conference, 

Tliompson Books, Washington/ D*C. , (SJCC), pp. 419-24; ' ^ . 

( ^ - ^w— 

The problem^ which Adams had to work around in the IBM 7010 experimental 

xsewriter are typical for CAI systems which used available equipment. Many 

technical problems may be solved for instructional users ^y following 

developments in generals-purpose systems. 

The core-partitioning and disk-fetch problems discussed are alleviated in 
a .virtual-address environment. .Use of drum &nd. relocation hardware are more 
suitable than the swapping scheme mentioned. ^ - 

He provides a useful analysis within his context. 



Bitzer, D., and Skapendas, "-The Design of. an Economic/tlly Viable Large-scale ' 
CtompWr^^^ Computer-based Ed. 

Research Lab, CERL Report No. X-5, ' also a Report to the Commission on 
Instructional Technology, 1969. 

* ■ 

The authors argue for economic viability of an instructional sxstem. ,The 
estimate of ten man-years for the system detvelopment is reasonable, and the 
^"plasma'* terminal upon 'which all dreads rest is rapidly approaching commercial 
status. ^ " « 

Other aspects In the cost estimates raise questions. For instance will 
authors adjust ^-o writing computer instructional material? Sdtiolarly boolcs • 
x^apd some texts ^wvide prestige and profit, and usually fulfill the ''publish - 
or parish" dictum^ Although some tiu^-sharing services do instafl applications 
programs ^d pay the author a use-rental, m4 at least one professional journal 
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is reviewing computer-based learning exercises, the area of mat :i_^s and 
authorbhip is weak component of the Illinois plan applied elsewhere. 



I 

L 



Adams^, E,N., "Technical Considerations in the Design of a CAT System," 
in the Proceedings of an NCET Seminar on Computers in Education held at 
Leeds, England, September, 1969. - ,} 



/ 



A good tutorial for persons interested in instructional use of computers who 
are not well informed about hardware and system ^considerations, although a 
number of specialized tetms are^left undefined. The document would be a 
useful guide also if references were included for more detailed information 
about 'terminals and time sharing systems ♦ ' * - 

The author provides a useful organization and conceptualization of technical 
considerations (for those who already know the content), e.g.. terminal tmd 
comnvuni cation options; separation of procedure and content; isolation of 
" control functions; generative techniques; and simulation. 

^lhe^diacussioii^afls^J:ems__is„^eak,_j_er^^^ because software considerations 
ar^ only half based i^^computer science and half in education. More work J 
is needed to relate data nbout hardware; point by point, ;o the administrative, 
psychological and instructional considerations. 



Breed. L.M., and Lathweil. R.H... "The Implementation of APL/360, • 

in Melvin Klerer, Juris Rfeinfelds feds. V.- Interactive Systems for Experimental 

A pplied Mathematics . Academic PresP; New York'. 1968, pp. 390-399. 

- . , \ . - ' ' ^ 

Tnis implementation was done^i^th both the APL characteristics and the idea 
of a dedicat^ed system in mind. The result has: 

\ 4 A supervisor which allocates .all system "res our ces according to a 
single comprehensive strategy; . 

b) A system design influenced by W advance analysis) of APL user programs 

^^^pefully representative); \ . 

* ' ' \ 
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c) Reduced overhead in the language interpreter because of attention 
to detail (via^ Si^ecialized programming techniqLues) . ^ 

APL is easily interpreted in spurce form. Thus there is no translation to 

a systactically rearranged internal form; only a lexical replacement is done 

\ 

on the input. Run-time analysis uses transition state Mi agrams, aa efficient 

* \ 
top- to-bottom method* \ ^ 

A number of storage management and swapping tips are includedi\as well as 
short discussions on error recovery and system self-monitoring/' Indirectly' 
it supports the advice that system building is not for novices (such as most 
CAI project directors are in computer scifence). 

Ei4vold, K.J., and Hughes, "A Multi-function Display System for 

/Processing and Teaching," IFIP Congress 69 , Amsterdam: North-Holland. 

A trimodal instructional system (author, student, or pVogram) is proposed. 
The article describes an implementation of the arrangement for an IBM " 
Modei 50 driving an IBM 2250 graphics terininal. Engvold*s article is very 
similar to an earlier one (CACM , Vol. 10, No. 16, ^^39) describing a similar 
system using an IBM 7040. The 2250 i3 flexible and fun, but ratherj e:epensive 
and really more powerful than necessary. What use is 8K of independent 
storage unless the student is doing very, very complex engineering graphics? 
The display of Bifczer "would suffice for any of the authors' demonstrations, 
and f,0T most of /what they propose. , , 

Frye, Charles/^., **CAI Languages: Capabilities and Applications," ^ 
Datamation (Sept., 1968), Vol. U, No* 9, pp. 34-37. Reprinted Richard 
C. Atkinso.. and H.A. Wilson "(eds.) Computer Assisted Instruction; A Book of 

Readings, Academic Press, 1969. 

- _ _ t 

Frye classifies languages used for instru<^tion as: 1) conventional compiler 
languages, 2) modified conventional languajges, 3) interactive languages, 
and 4) special instructional author-languages. > ' . 
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\ . . . . . 

Using these language categories the author considers: 1) user orientation, 
2) lessdn handling, 3) record handling, 4) conditional branching, 5) answer 
inatching service routines, 6) ■ calculation features, and 7) communication 
devices* - ' ' 

« 

Some-^of the information is misleading and the general discussion is not 
supported by specifics but is nevertheless useful. Consideration of general- 
purpose along with special-purpose instructional languages is important. 
More could be made about some truly essential or primitive^eatures found 
in many CAI languages. 



Frye suggests that instractional author-languages arose because standard 
pr^gamuing languages were too difficult to use and experienced programming 
help was* too expensive. He should also recognize that although the prospective 
author "need not learn as much to use a specific instructional language^ he 
will not find it t^sy to, deviate much from those programming styles and ^ 
^ learning tasks which originally inspired the language. 



Furthermore, new techniques for extending general-purpose languages (or 
gei^erating special adaptations) will make relevant computer capabilities 
more accessible to non-specialists, among them the designer oi computer-based 
lessons.. * ^ 

Glass, H.L., "An Elementary Discussion of Compixer/Interpreter Writing," 
^Co mputing Surveys, (Marcli 1969)^ Vol. 1, No. 1, pp. 55-77. 

.. - ■ - }'.--■ ' 

Elementary techniques are discussea for the translation of programming 
languages*. Detailed discussion centers around a *PL/1 interpreter which the 
author uses for an example. 

A good annotated bibliography follows the article. 
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Johnson; B*F-, "Design of an Operating System for the Control of Student 
Terminals in a Comput8r-|)ased Instruction System," IFI? Congress '68, 
Amsterdam: North-Holland* 

The RCA project described is quite straightforward technically. The use of 
re-entrant teaching programs, is a good feature, and quite common for imple- 
iSentation of system programs; the teaching strategies are ti'eated as system 
programs in the RCA system. 

A background job stream should use residue CPU time and 'various other modes 
of computer use sWuld be encouraged by additional facility. The system is 
rather narrowly" conceived but well executed. It did have to be redoi(e to get 
it ^running in the NYC schools the next year;^ current documentation is avail- 
able from RCA, and user opinion from schools in NYC and Pontiacj Michigan, 

r ^ , 

Lyon, Gordon and Zinn, Karl L. , •'Some procedural language elements liseful in^_ 
an instructional environment," In the Proceedings of- an iSCET Seminar on^ 
Cgmputers in Education held at Leeds, England^ September 1959. / 

This paper attempts to attack the instructional language-problem on the 
following fronts: A) Given reasonable demands, what programming language 
primitives adequately meet the requirements? B) How are the language 
features (or prlmiti^s) feflfcted in contemporary languages;? 

Suitable language primitives are discussed as parts of some general -purpose 
language* If thej.anguage will be used in interactl^ve mode, some parts must 
be implemented as an interpreter to allow the; very la^te binding times needed 
for flexibility. > . 

If viewed as an attempt to cast light on procedural features in instructional 
computing, the paper may s\icceed. However, the hypothetical pTogramming 
language described should not be taken very snriously* ^It is "cumbersome, 
vague, and p.atchworkj at best a sketch, certainly not a blueprint," as 
viewed by the authors . \ 
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^lorton, M.S,,S., and Zannetos, Z.S,, "Efforts Toward an Associative Learning 
Instructional System," IFIP Congress '68, Amsterda^i: North-Holland. 

• ? . 

The authors propose a computer-driven interactive terminal linked to an asso- 
ciative memory with flexible search proeedures to solve: a) lack of integrated 
instruction material; b) the inflexible pacing and sequencing of students ^ 
Postulated charactertistics of the system include semantic content association 
and learning (via pattern matching and adaptive characteristics). 

The semantic memory has been programed in such simplified form. An account- 
ing course provided material formal enough sq that keyword searching provided 
adequate "pattern matching". Pointers in the ass^ociative structures linked 
to other key words, thus providing rudimentary inferential powers. 

t ^ 

The authors propose that semantic content, pattern recognition, adaptability 
(and, in additi^n^ hardware flexibility) are the basic components of 
instructional teaching.* An exhatistive teSt;ing of the prototype may provide 
some Indication, ylrhaps encouraging an implementation which comes closer to 
testing the authors' hypothesis. * ' ; 

Tonge, F.M., "Design of a Programming Xaftguage and System for Computer 
Assisted Learning," lilP Congress ^68 ^ Amsterdam; North Holland. 

This is a well balanced summary of a system which became only" partially 
operable at the University of Calif oriiia at Irvine. The view of early CAi * 
languages as "five years b^hiicid the state of the programming art" rings true. 
The section on the requirements of the^-UC Irvine system ILs Edifying, and 
some postscript on continuing problems would be usef\]±r 

Tonik, Albert B*, "Development of ^ecutive Routines, Both Hardware and ' 
Software," AFIPS, Fall Joint Computer Conference > Vo, 33, pp, 395-408, ; 
Thompson Books, WashingtoAv^.C. " - \ 
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This tutorial ^expands from an elementary executive to a* rather complex one. 
Topics include: simple executive, multiprogramming, Raging, and multi- 
processors . _ j ^ - ^ 

In addition to the main article, there is a chronologically ordered bibllo- 
graphy with articJGo' dating* from 1948. ' ' 

Zirn. Karl L. , "A comparative study of languages for programming jinteractive 
use of computers in instruction," Final report \inder ONR contract N00014- 
68-C-0256 (Feb. 1969), EDUCOM, 100 Charles River Plaza, Bdstom^ass., 
02114. 1969. . ^ 

This report was preceded by the author's two other entri^s^in this biblio-^ 
graphy which are more available. It includes much of the detail promised 
^n the other two: examples of actxial code, summaries of languages, a 
discussion on interactive languages, a glossary of terms, aspects for a 
system =taxonomy, and documentation guidelines.' ^ * . *: 

More interpret able and directly useful work is in preparation in connection 
with Project CLUE* 



Zinn, Karl L. ,^**Programming conversational use. of computers for insjtrtiction. 
Proceedings of the 1968 ACM National Conference, Brandon/Systems Prg^, Inc. 
Princeton, N.J.,. 08540, 1968. ' * 

From the 30 or so available languages for .conversational instruction only 
3 or 4 really different kinds have appeared. The author suggests: 1) 
successive-'frame, 2) limited-context conversation, 3) presentation of a 
curriculum file by a standard procedure, and 4) data analysis and file 
editing. ^ - 

tour types of users are con3idere<ii\ instruictors, authors of instructional 
strategies, instructional researchersV and pfogramaers and systems people. 
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Further discussion explores languages in a general-purpose, time-sharing 
environment. Extendibility is mentioned. T^e article concludes by comparing 
two low-cost extended languages (FOIL and FOR^IT) and two standard languages 
for conversational ins^truction (COURSEWKITER and PlANIT.) • 

Zinn, Karl L., "Languages for prograinming conversational' Use of computers 
in instruction,*' I FIP Congress 1968 > Amsterdam: ^North Holland. 

\ 

An outline -oj a comparative study of existing languages (then in progress) 
with tentative suggestions 'for improvements. Recomiriendations are derived 
from comments by authors of materials for various systems. The author also 
describes languages under development for a generA-ilurpose system at the. 
University of Michigan (IBM^ 360/67 using the Michigan Terminal System) . 



o 



Zinn^ Karl i "Instructional programming languages^ A five-year 
perspective," Educational Technology , March 1970. 

. • . . ^ '\ .1 

Transcript of a presentation made at AERA'in February 1969, this paper 

criticizes present languages and techniques for frame-oriented instructional 

^programming anu suggests new approaches' to achieve effective and economical 

instruction by computer in the tutorial mode. The author recommends problem 

solving and procedure-writing uses for now. because of economy and greater 

accessibility by individuals and smaller institutions T Some of the conclusions 

liave been incorpqrated in the. background statement prepared by the .OECD-CERI 

meeting. ' . « > 
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